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FOREWORD 


f 

The second NASA sponsored Workshop on Synthetic/Enhanced Vision (S/EV) 
Display Systems was conducted January 27-29, 1998 at the NASA Langley Research 
Center. The purpose of this workshop was to provide a forum for interested parties to 
discuss topics in the Synthetic Vision (SV) element of the NASA Aviation Safety 
Program and to encourage those interested parties to participate in the development, 
prototyping, and implementation of S/EV systems that enhance aviation safety. The SV 
element addresses the potential safety benefits of synthetic/enhanced vision display 
systems for low-end general aviation aircraft, high-end general aviation aircraft (business 
jets), and commercial transports. Attendance at this workshop consisted of about 112 
persons including representatives from industry, the FAA, and other government 
organizations (NOAA, NIMA, etc.). 

The workshop provided opportunities for interested individuals to give 
presentations on the state of the art in potentially applicable systems, as well as to discuss 
areas of research that might be considered for inclusion within the Synthetic Vision 
Element program to contribute to the reduction of the fatal aircraft accident rate. Panel 
discussions on topical areas such as databases, displays, certification issues, and sensors 
were conducted, with time allowed for audience participation. Most of the presentations 
focused on using SV to reduce Controlled Flight Into Terrain (CFTT) type accidents. It 
was also emphasized by several representatives that the airlines will need to see a cost 
benefit before installing new SV systems. It is believed the SV systems could provide 
expanded operations at airports during low visibility conditions, which in turn would 
provide an economic plus safety incentive to the airlines for SV systems. 

This workshop emphasized the cost-effective use of synthetic/enhanced vision 
displays, worldwide terrain data bases, and GPS navigation to eliminate visibility-induced 
errors for all aircraft. At the time of the second workshop, a sensors development thrust 
was not envisioned to be a part of the SV element. The low-end thrust portion of the SV 
program will attempt to provide an affordable synthetic vision display system for the low- 
end general aviation aircraft operating in Visual Meteorological Conditions (VMC) to 
enable safe transit back to VMC in the event of the unplanned, inadvertent encounter of 
Instrument Meteorological Conditions, including low ceiling and low visibility weather 
conditions. It may also address loss of situation awareness and unusual attitude issues. 
The high-end thrust portion of the program will attempt to realize/demonstrate the 
potential safety benefits of synthetic / enhanced vision display systems for both high-end 
general aviation aircraft (business jet) and commercial transports to enhance situational 
awareness and tactical flight path management in low visibility weather conditions. 
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Note: The following notes were taken in real-time at the workshop. Video tapes of the 
panel discussions were viewed after the workshop to verify and augment the notes which 
were done in real-time. Some portions of the panel discussions were not recorded due to 
technical difficulties. Hence, some of the entries in this Notes section may not be in 
complete sentences. 

Synthetic Vision Workshop 2 
January 27, 1998 

WELCOME (Carrie Walker) 

Good morning and welcome to LaRC. This is a very important event in the life of the 
Safety Program. This is the second workshop. Number one was a get acquainted. 
Objectives of first workshop were to: introduce Synthetic Vision Element (SVE), receive 
feedback, encourage involvement, discuss procurement process and establish panel 
sessions for workshop number two. 

Panel topics for this second workshop are: Presentation Methods for 3-D Perspective 
Displays; What’s Next After Predictive CFIT 2-D Displays; Just Do It— Can We or Can’t 
We; Databases; and Advanced Vision and Sensor Technology Role. 

The overall objective of the workshop is to further define the SVE. The format of the 
workshop is a combination of presentations and panel discussions. Some aspects of the 
workshop will precede to give background for problems. A product from this workshop 
will be the framework of a NASA Research Announcement (NRA) wherein we hope to 
gather information to put together the NRA. We see multi-organizational teams 
responding to the NRA. 

Before Mike Lewis speaks, I would like to introduce: 

Susan Conry, Secretary, CVIB, FDCD 
Mike Lewis, Program Manager; AvSPO 
Carrie Walker, Program Manager, ASPO 
Lynda Foemsler, CVIB, FDCD 
Russ Parrish, CVIB, FDCD 
Mike Durham, AvSPO 

AVIATION SAFETY PROGRAM OFFICE OVERVIEW fMike Lewis) 

Thanks Carrie. Good morning. I am going to give a quick introduction. Similar to last 
time. We have here a large international participation. I will give you my perspective as 
Director of the NASA Aviation Safety Program. Here is a quick background: The 
AvSPO sees safety as a global activity. If aviation is going to continue to grow at its 
current rate, we need to do something about the accident rate. Increasing traffic equals 
increasing accidents. Strong proposal coming from the Gore Commission was to set a 
target of 80 percent reduction in fatal aircraft accident rate over the next decade. NASA 
has signed up to develop a focused research program to make that happen. NASA has a 
Three Pillar goal, and goal number one is for safety. This Synthetic Vision Technology is 
an important part. NASA is only one part of what is needed to make it happen. Cannot 
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just do research. This program will be FAA, industry, and NASA--a partnership. Not 
just R&D. All pieces of the puzzle are needed to make this program work. 

The philosophy of the program is we don’t want (NASA) to pay for all of anything. We 
are not trying to buy from NASA a reduction in accident rate. Do not see trying to 
increase NASA budget. We have a set budget and will do what we can with it. NASA 
will be the potential catalyst (among industry, FAA and NASA) for R&T side- given 
appropriate ideas. We want an NRA to come out which will allow appropriate teaming 
which will make it all happen. 

CFIT talks about aviation safety. Use wheel icon to talk about Aviation safety. An 
accident occurs when light shines through these rotating disks where holes (indicative of 
crew error, weather, aircraft faults, etc.) line up. Philosophy of this whole synthetic 
vision type of approach is that CFIT and loss of control accidents is a number one issue to 
attack. 30-40-50 percent of the aviation accidents are of this type. This is the problem we 
want to attack. The approach when I look at CFIT is pretty common to nearly 90 percent 
plus — is that the initiating event in CFIT and loss of control accidents is you cannot see 
well out the window. A potentially powerful way to attack CFIT and loss of control 
accidents is to think about the visibility part of the equation and attack that. Re-create 
daytime VMC (with Synthetic Vision Display system) to attack the whole problem. 
Visibility-induced crew errors is the problem. If you could see out the window, you 
could catch the mistake and the accident wouldn’t happen. 

Intriguing news is that GPS is more available. As is, data storage, digital processors 
(doubling every couple years), and glass displays. These technologies are the building 
blocks to the synthetic vision approach. No new inventions required. It is technology 
that’s already available. Elements need to be systematized with a human factors 
approach. Lots of stuff needs to happen, but no new technology development. In order 
to make system effective, we need to rally around a particular approach. I see 3 goals: 
( 1 ) eliminate CFIT by solving visibility problem, (2) provide affordable CFIT and loss of 
control avoidance for GA, and (3) use SV/perspective displays to provide stepping stone 
for future— all visibility/all runway manual operation. Lastly, the purpose of workshop is 
to identify key technical issues/hurdles, provide govemment/industry and 
industry/industry interchange. For our part we want to make sure NASA/govemment is 
doing the right kinds of things. Allow NASA to intelligently structure NRA (the 
solicitation) by making the statement of work to allow right teaming, to determine 
NASA’s role, and right response from industry. Big deal for goal and for aviation world- 
-we want to do it right. Little bit of separation in my mind. Money is not a concern with 
me right now. Funding will follow aggressiveness, attention, and interest of groups in 
this whole arena. NASA budget will not pay for everything. A part of making this work 
is that there is a powerful commercial opportunity in place. Wanting to do it right is the 
key. 

CURRENT SYNTHETIC VISION PROGRAM DEFINITION (Lynda Foernsler) 

Current program definition: Had a national goal to decrease fatal aircraft accident rate by 
80 percent in 10 years and 90 percent in 20 years. 
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Type of accidents are loss of control of flight and CFIT which are major contributors to 
the fatality rate. Fatality rate anywhere from 30 to 40 percent in transport world is 
attributed to CFIT accidents. A great percentage of total aircraft accident rate are 
attributed to CFIT or loss of control in GA world. 

Background information 

• A lot of work has done from Don Bateman of Allied Signal. He is considered the father 
of the Ground Proximity Warning System (GPWS). 

• Since 1958 over 8000 people have died due to CFIT accidents. Introduction of GPWS 
in the 1970’s significantly reduced this number, but more still needs to be done. 

• In 1991-1995, there were over 3000 fatalities in 59 transport accidents. 29% of these 
accidents were attributed to CFIT. 

• In business jet arena— 2 to 3 times more CFIT accidents in the business jets as 
compared to airlines. 

• Primary cause of fatal accidents in GA is attributed to weather. Weather-related 
accidents usually involved controlled flight into terrain or other objects or uncontrolled 
flight because of 

spatial disorientation. 

Current CFIT Preventive Methods 


• In December, it came out in the press that airlines were going to voluntarily put 
Enhanced Ground Proximity Warning System (EGPWS) on their transport airplanes. 

• In 1992, Flight Safety Foundation (FSF) established a national goal of reducing CFIT 
accidents by 50 percent in 5 years (by 1997). FSF improved training methods for pilots 
and controllers by providing them CFIT avoidance information. FSF developed a CFIT 
checklist for pilots to assess a flight situation for the risk of CFIT. 

Why SVE? 


The majority of CFIT accidents (transport aircraft) and Loss Of Control accidents (GA 
aircraft) can be considered to be visibility-induced crew error, where terrain visibility 
would have been a substantial mitigating factor. 

Many accidents happen because of poor visibility or night conditions. SVE will give pilot 
better vertical and lateral situational awareness. 66% of CFIT accidents have been 
attributed to poor vertical situational awareness, SV display systems present a picture to 
the pilot. He is able to picture where his aircraft is with respect to the terrain and picture 
where his plane’s flight path is with respect to the terrain. 

The goal of SVE is to eliminate visibility-induced crew errors for all aircraft (low-end 
GA, business jet, transport) through the use of 3-d perspective displays, onboard world- 
wide terrain databases and GPS navigation. By using these 3 elements, we hope to 
eliminate CFIT accidents for all phases of flight. Also, since GPS will be available, we 
can use it and 3-d perspective displays to provide the pilot with precision approach and 
landing guidance. We can use SV displays as a stepping stone for all visibility/all 
runway manual operations. 
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Use 3D perspective displays, GPS navigation and onboard terrain database to do CFIT 
prevention. Synthetic Vision Display System (SVDS) gives pilot a picture of the world. 
Hopefully this mental picture increases pilot’s situation awareness. Can put horizon, 
velocity vector, or whatever flight symbology information is needed on SVDS. CGI 
gives pictorial view of the world, can be augmented with necessary flight information. 

Within this program we are looking to prevent CFIT accidents in low visibility/night time 
conditions. Low-end thrust will provide an affordable synthetic vision display system for 
the low-end general aviation aircraft operating in Visual Meteorological Conditions 
(VMC) to transit back to VMC in the event of the unplanned, inadvertent encounter of 
Instrument Meteorological Conditions, including low ceiling and low visibility weather 
conditions. This system will provided the low-end GA pilot with attitude and terrain 
awareness. High-end thrust will realize/demonstrate the potential safety benefits of 
synthetic/enhanced vision display systems for both high-end general aviation aircraft 
(business jet) and commercial transports to enhance situational awareness and tactical 
flight path management in low visibility weather conditions. The approach used in low 
and high-end thrusts is to do system studies, piloted simulations, systems technology 
assessments and flight tests on candidate SVDS. Our anticipated partnership is to go to 
the user community — pilots, aircraft avionics/manufacturers, FA A, other government 
organizations, universities. Everyone working together to develop SVDS to eliminate 
CFIT and loss of control accidents. Starting in FY98 with 500K. NRA will be issued in 
January 1999. , v-” 

BUSINESS VEHICLES - NASA RESEARCH ANNOUNCEMENT (Mike Durhaml 
Will talk some in regards to what Mike spoke of about partnering philosophy and hit 
lightly on business mechanisms that are available in the NRA. I will have a quick 
definition of NRA and why we are taking this approach. I will conclude with the desired 
partnership philosophy. We will look at what teams will provide back to NRA. At the 
end, we will touch on update access to an AWIN amendment on the webpage and on an 
asynchronic NRA and when and how it will be developed. 

First area is the partnering philosophy. Philosophy for this program is to provide a 
funding catalyst and not pay all of anything approach. We will not take the redirected 
budget and buy a reduction in the aircraft accident rate . We do want to take funding and 
by working with you find the place we can attack and make a difference— that is what we 
want to invest. We intend to stretch industry timescales for investments and reduce 
NASA timelines. Encourage industry to invest in products a little further out (3-5 
years). ...be honest you (industry) are here to make a buck. Your challenge is pay for 
salaries and facilities next year not 5 years from now. By teaming with operators, 
subcontractors, and government we are able to look further out. Have time to recoup that 
amount of money. Willlook for more effective research development. We want to cure 
the problem (accidents) instead of adding another band-aid to the cockpit. If look at the 
GA cockpit from 40, 50, 60 and 70's (none in 80’ s), we went from a nice simple flying 
machine to today’s cockpit which is full of gadgets. We’ve added gadget after gadget to 
the cockpit. We need to clean up the collection of band-aids and make a system. Will 
take multiple teams of companies to do that. A new approach. Find a cure. Want to hear 
from you what is government’s role and what industry can lift up and compete to make 
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the aviation system better. What are right standards and procedures for this system? 
What is governmental role. In general, we want to increase risk tolerance through 
partnership and have system implementation provide more rapid ROI. As industry 
partners, you can lay down standards. Lower cost of the system and increase volume by 
developing system standards. 

Moving on to business mechanisms. Look at how you do business with federal 
government. We want to do things differently. Need to use different tools. Aviation 
Safety Program does not have one answer. An array of tools will be used. Will use best 
tool for your team. In general there is a whole array from grants to classical fixed price 
contracts. Every box has an array of negotiating clauses and uses. What I am trying to 
show is that there is probably a best approach with the different business tools depending 
on technical research to be done. Want to choose the right tool in terms of technical 
research being done. Depends on what government is buying o determine what business 
mechanism should be used. If what we are paying for is an investment in industry 
standards, than industry needs to be co-funded. What I want to steer you to is the 
middle— Aviation Safety Program should focus on cooperative research agreements. 
They are cost-shared and co-managed. They are very powerful for developing teams. 
They can have multiple competing cooperative research agreements. Not as much 
government control, but influence and relevance for national effectiveness. Government 
is giving up control, but getting more influence. Alluding to NRA--NASA Research 
Announcement. A fairly open, flexible solicitation where government is saying we want 
to work in this area and we have some ideas, but we need industry to tell us what they 
think needs to be done and what type of business mechanism should be used. A request 
for research proposals conceived by offerors in broad technical areas. Used where 
impossible to address specifications in sufficient detail. An NRA approach can be used 
wherein there is a multiplicity of approaches. NRA cannot be used in place of a RFP. 
Multiple awards can result from single NRA. NASA determines appropriate business 
instrument to come back and negotiate the terms of. Contracts resulting from an NRA are 
subject to the Federal Acquisition Regulations. 

Desired SV proposal attributes: teamed proposals with proper technical breadth/focus 
and direction to contribute to 10 times goal, partnership representing aviation community, 
consider complete path from technology development to test to certification of 
implementation, efficiently managed team through one prime (a business agreement with 
sole business partner.). Proposals which are data-driven, metrics-monitored. Proposals 
need to specify transition path, including issues like interoperability and upgradeability. 

QUESTIONS AND COMMENTS for Mike Durham 

Question: Does this alliance have to have joint venture.. .can have single contract. 

Answer: Yes. Not much of an entity to do that. Front end of business office (legal 
agreement)... 

Question: In regard to emphasis on cooperative agreements, are you contemplating a fast 
track method to provide legal support? 

Answer: We will not come in and help make individual agreements within your team, 
but this investment by the team will bring an overall savings in the long term. Far less 
red tape in dealing with government for life of contract. Not same reporting 
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requirements. A trade off. Government will provide generic cooperative agreement 
between us and the entity. A price up front but easier to deal with fed government 
through cooperative agreement— that part will pay for itself. Facilitators out in the 
business world that can help you. I do emphasize that you need to start teaming now. 
Don’t wait for NRA to come out. Deadline for proposals has been extended for AWIN 
NRA. 

Question: When is SV solicitation coming out? 

Answer: Summer 98 

PANEL ONE : Presentation Methods for 3-D Perspective Displays 

Chair - Tony Lambregts 

Members: Jorg Baker, Ross Beins, Dave Foyle, Pete Howells, Michael Zuschlag 

Tony Lambregts. FAA (NRS for Flight Controls) : From time to time we get drawn 
back to presentation methods of 3D perspective displays. Not entirely clear yet what the 
territory of operation is for this research. One of the first ideas I struggle with is there 
may be a clear aspect of increasing the use in GA aircraft and one impediment is weather. 
If there is weather and you have to fly in instrument conditions and don’t have training 
you can’t do it. If you get into instrument flight conditions inadvertently that is one of 
the bigger risk. First thought is are we going to putting on more sophisticated display 
/guidance systems for the less skilled pilots and draw these pilots into more dangerous 
situations and create more accidents. We set out to make things safer but inadvertently 
we make things unsafe-something to contemplate. Another aspect is if you draw on 
sophisticated technologies— there is a price tag — if too high going to have very limited 
chance in selling your product— need to keep this in mind. Have recently signed up 
w/FAA that means certification. If you come up w/good ideas before you can sell it and 
put on airplane going to have to certify it. Certification can be a very daunting task and 
the main problem with certification is not so much you don’t have idea right but main 
problem is you have to look at angles of what can go wrong with product that you 
provide. It means you have to have systems engineering, integrity, the right safe guards 
in cases where it doesn’t function. These aspects are much more difficult to bring to 
fruition than just the basic idea. These are the things I will throw out for comments. 

Jim Daum. Boeing Helicopters : Want to comment about earlier statement of making 
IMC/VMC. Think what you bring up is if we just make a system for when pilot is 
getting in trouble and not using it all the time then they won’t have the experience 
necessary when they go to use this product. I propose that we make the product. Another 
issue is why does a pilot want to have this device on when the weather is good. We need 
to make the product so it enhances his ability even during VMC flight. You give him 
increased enhancement for navigational cues, give him pathways to the sky, make him 
want to use even when it is VMC. So just by limiting to loss of control during 
inadvertent IMC —is limiting ourselves. We want to make IMC flight/VMC flight or 
even better make him use this as his primary instrument for navigation, flight control, etc. 
Must make him feel he’d rather use this then look outside. 
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Tony ? No doubt that it has to be something that’s used. Bigger problem is it must be 
implemented in a much the larger percentage of the population than currently exists. 

Phil Brooks. Allied Pilots Association : Had a meeting w/technical pilots and the 

manager of Flight Operations Safety and they talked certification, certification, 
certification. I would submit that we have opportunities to innovate in certification front. 
Aware of work of a Mr. Burt Green in getting HUD displays on transport aircraft. Right 
now Aerospace Recommended Practice for HUDs, ARP5288, is currently under revision 
by the Society of Automotive Engineers to be submitted to the FAA as operating standard 
to certificate HUDs. Other airlines are now operating HUDs. Happened because Mr. 
Green wrote a document and through certification pushed it through under what is termed 
a special condition. Believe that synthetic product(s) that come forth out of this program 
will have to be certified by documenting what we are doing as we go along so by the time 
we have the product we will also have the manual that goes with it and they go to the 
FAA and say special conditions certification and then SAE afterwards and write up a 
formal standard. Convinced certification is the hinge upon which this whole thing hangs. 
Would appreciate any comments from the panel on any insights in how we can do this. 

Tony Lambregts. FAA : If we make a product that a VFR pilot can use to get out of 
IMC conditions, the Feds will probably be understandable and certify it if it is that good. 

Comment : Will comment on certification of HUDS. Very difficult. Lot of problems 
with presenting pilots w/ information because it has to be of high integrity. Takes a lot 
of time to certify those HUDS. Another comment is that of cost benefits, up to this year 
the only reason we got system on airplanes, is justifying by saying increase the number of 
landings; although when system on airplane HUD is seen as situation awareness 
enhancer— now airlines and users are starting to understand that and are coming through 
saying they are installing because of situation awareness instead of commercial benefits— 
think we are seeing a change. Big issue is to convince the customers the system is going 
to enhance situation awareness. I think this is one of the biggest challenges. 

Comment : There is a distinct difference between making a display that is intended to get 
a pilot out of IMC conditions and making a display that is intended to work both 
VMC/IMC conditions. Two very serious problems with this is (1) it is very difficult to 
duplicate all of information that a pilot uses during VMC conditions on a display. Done a 
lot of research into this and I don’t think you are going to do it. (2) Comment made about 
making system so good that you don’t have to look out the window. This is just what I 
am afraid of. If you make it (the system) more compelling than reality, we have seen 
where pilots are drawn to displays even in the presence of information contrary to what’s 
on the display and they will inadvertently go to the display because it looks so good not 
because of the integrity of the information that’s contained there. So I’m concerned if 
you make a display intended for emergency operations only and the pilot uses it all the 
time— maybe there is an inferred reliability/trust that is not there. Must make sure we 
don’t build something that is misleading. 

Tom Leard. Honeywell :. In regards to making your way out of IMC versus having a 
display you use all the time. I would submit that in our training process for initial private 
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pilot we talk about integrated training approach where altitude and instrument flying is 
integrated in as part of the leaming/flying process. I would submit that even today’s air 
driven, unsophisticated but effective attitude indicator or air speed indicator or altimeter 
are used time and time again from earliest time frame and they present a good model for 
how we would want to develop this CFIT preventing system in how we want to train and 
use. The question is where should we draw the line relative to where a 3D perspective 
display would best be presented. Is it best presented given all the issues in the primary 
flight display environment (or aviator display) or more appropriately displayed in what 
we call the navigation display which some would argue is a multi-function navigation 
display environment? 

Comment : I think there is a pretty straight forward answer to this. Can you present both 
navigation and primary flight display information in one unit in one synthetic vision 
display. Another alternative is you can have switchable modules and if person flying and 
he wants a pitch ladder and a horizon line in his synthetic vision display he can select 
that. If he does want that and there is clear visibility outside of the wind he just looks out 
of window he does not need his pitch ladder. He has outside references— he can do fine 
and yet he would still have a synthetic vision display that might have a high way in the 
sky— it might mark the airports he’s going to. He can look out the window to see 8 or 10 
miles but he cannot make out airport on the terrain; but yet his synthetic vision display is 
marked and he can see where it is relative to the plane so he can see what way to go. 
Many times flown up to airports that are grass strips and been right over them and still 
had a hard time flying. If it had not been a couple of airplanes on the ground, I probably 
would not have found it. To have those marked in a synthetic vision display might be an 
assist in that kind of situation. 

Comment : Perhaps the distinction is not so much between navigation and primary flight 
displays as between tactical information and strategic information. I think the synthetic 
vision displays provide more tactical information more or less short term information up 
to a few miles ahead; perhaps would augment with navigation displays, but it is not going 
to tell you what’s behind you if you’re making an approach with a large curve won’t 
show you what is over on the other side of the curve of the earth so that might be more of 
a role for secondary displays such as the navigation display. 

Comment : I think synthetic vision right now with the display we have the user can 
actually browse a terrain and as he is navigating we take the GPS input and show what 
things look like out in front of him, but if he’s coming up on a hill he’s got a certain 
range and if he does not know what is over that hill he can actually browse that 3D terrain 
and throw his altitude up and take a look at that hill in that synthetic vision display and 
see. He can take a look behind, forward, aft, left, and right and see what’s around him. 
He can actually look ahead in lat and long and browse any point in the database and take 
a look around in that terrain and than after so many seconds the display will snap back to 
where he is and present his navigation display as he’s navigating. So I think it can be a 
combination of both of those. Also were finding working with different DEM models, 
you have two things— the accuracy issue and resolution— the fewer data points you have 
on your DEM model no matter what CPU your using you can look further ahead and that 
is a pretty powerful tool also. But if your try to resolve things down to a very high 
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resolution with DEM models you start chopping up the CPU power so much that you’re 
not going to get a long range terrain display. 

Comment : I think we should look at CFTT as more than just control flight into the 
terrain because it should be control flight into trouble and I don’t think we should define 
too narrowly. A gentleman earlier commented about being scared the pilot would not 
look out the windshield if he had a SVDS. Reality states that we have to look at this 
towards the future anyway. I am not saying you should not have pilots looking out the 
windshield— that’s not a good idea. What I am saying is whatever you do should not be 
predicated on having a windshield to look out of — it may not be there by the time we 
implement this kind of system. Just think we should open up our thoughts to all of the 
trouble we may fly into. 

Sv Levine. SISTMS : I think control flight into trouble should be the definition. We are 
talking about database (DB) systems. DB systems were done in marine and they got into 
trouble unless you see the things in front of you that are not in the data base you got 
planes flying and all other sorts of targets. In addition these forward sensors allow you to 
validate the DB. If you look at the DTED data used for cruise missiles you get an idea of 
what the altitudes are and therefore you can put together with the ends. On the GA it is 
more difficult problem because of the dollar issues on the big planes on this whole idea of 
integrating what is CFIT. I notice all the ones previously had GPS, data storage, 
visualizing, glass display— where is the other data which is planes, air traffic, collisions, 
etc. That whole thing has to be put together as an integrated system. 

Comment : I have been looking at that to and we want to present some of that 

information and basically it is a matter of obtaining the information. We can obtain it by 
sensors, by data link but it is really getting into the cockpit. Once you get a computer in 
the cockpit, you can do wonderful things with it as long as can crunch the right numbers 
and the right data through it. If we can get weather information up, we can lay weather 
over the chart or we can put a big red blob in the sky that shows severe turbulence. Or we 
could put some other thing between the runway and the pilot showing him there’s a down 
draft and you are going to get a free ride in to terrain with micro burst if you don’t know 
about this and we could put that microburst right in front of him. Question is how do you 
get it into the cockpit and that gets into data link areas and FAA is working on that. Not 
difficult to do just requires a national implementation. We can show you in synthetic 
vision display the traffic, traffic vector, can delete out presentation of aircraft that is not 
relevant to flight but we need to get the data in and maybe that data is available to us on 
the TCAS system. That is something I need to find out. 

Steve Young. LaRC : Been working on presenting synthetic vision to pilots on the 
airport surface along with Dr. Foyle. What I want to ask the human factors people is 
there a compelling argument when you compare enhanced ground prox auditory alerts vs. 
visual reproduction of a visual scene. Is there argument for or against either of these 
approaches. 

Comment : There are several things you can provide. First not either/or. You can 
combine them. In fact the Honeywell system does combine them with a plan view of the 
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terrain in addition to auditory alerts. Lot of things you can show with visual 
representation that you cannot show with auditory which is why they can augment each 
other. By showing terrain visually especially in perspective display has potential of 
showing escape routes so don’t just have to go auditory command if you find turning 
away from terrain might be better for a particular terrain. Also can give you a preview of 
terrain before you get so close it is going to trigger an auditory alarm. You can tell if it’s 
rising or falling terrain. Use this to plan your path before you get into an auditory alert. 

Comment : The organizers of the panels wanted to stick to the question of what about 
presentation methods on 3D type perspective display. So would like to draw audience 
back to this which is totally new wherein most of data dealt with has been ID single 
instrument providing a bit of information either in an analog way or numerical way. All 
of sudden we have possibility with new display technologies to go to 2D (planform) or 
we have a 3D capability. Think this is what this panel is to address and what about these 
new dimensions we can use in displays-is that important to safety. 

George Kaseote, FAA : In response to the United Airline gentleman on the GPWS. 
During the ??? accident GPWS was screaming. In the human factors area we need to 
look at more alerting situation the further down the line you go. In Guam accident there 
were all sorts of audio cues. The crew got calls at 500, 100, 50, 40, 30,20, 10 into the 
ground. We need work in the human factors area. 

Comment : This is a really good point and this becomes a point of information overload. 
You have instruments you are reading instruments and they are ID and they require 
interpretation and you have to go through interpretation process to figure out what your 
situation is and then when you get into navigating its even more abstract process to figure 
out your location and then when you go into navigating in 3D in relation to terrain it is 
almost virtually impossible with current instrumentation in aircraft to really know what 
the terrain is below you if you can’t see it. 3D navigation gets very difficult. If 
somebody’s making an approach with alarms going off, they become disoriented and in a 
state of confusion. Need to keep pilot oriented so he can see where he is. If he does 
become disoriented just look at display. This goes way back as information overload — 
Goes back to Vietnam pilots with people talking to them, alarms going off this makes the 
pilot turn switch off and look out the window for SAMS because he does not want to hear 
it all. Have to be very careful as to what we want to present the pilot with. Don’t want to 
load up synthetic display so that it’s cloogy. The approach of display is something we 
have to have great caution with. 

Comment : Along these same lines have a concern that this area (over the years) has 
been very hardware driven in terms of specific capabilities. I think that it is important to 
step back from that and design whatever system is proposed or sets of systems that is 
human centered. Important to have a process to have to go through formal testing and 
formal evaluation. But before that, you have to see what is the problem— what are the 
information requirements that you are designing for. Need to understand from an 
informational point of view what the pilot needs. 
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Doug Trumbull. Entertainment Design Workshop : In the entertainment business we 
often photograph information 180 degrees wide so we can fill the entire human field of 
view and present in hemispheric display system. We also can superimpose natural human 
field of view reality with graphic computer images and layer with perfect registration. So 
it is possible to take graphical display of terrain or air corridors or flight path and 
superimpose it over reality. I think the technical challenges of getting that synthetic 
reality superimpose over reality out the window of aircraft is a minor task. Don’t think 
you want to look down at anything. You want to look out the window. My philosophy is 
to take some of the best knowledge of the flight simulation industry and get yourself a 
new superior image out the window. Superimpose over natural reality— like a HUD a 
that’s 180 degrees wide. 

Comment : Sounds very impressive to me but are we still in financial reality. 

Doug Trumbull : Cost of graphic accelerator cards for PCs or laptops are extremely low 
and extremely powerful. In addition in talking 3D displays which I think what is meant is 
XYZ-coordinate geometry of some kind of display 2D on a flat screen. I think 
stereoscopic vision is extremely important human perceptive quality that is very profound 
and powerful and think stereopsis ought to be included in factor of display to pilots. 

Kim Kaiser. Alaska Airlines : Want to give operator perspective to guidance vs. a 
display. Been run Enhanced Ground Prox on our airplane for a year and find a significant 
change in the crew operation on not even getting into an alert situation. Particularly in a 
simulation when we try to set up to get them into a ground prox event and it is very 
difficult if not impossible to get them there if they have the terrain map up in front of 
them—have to end up taking the map away to get into actual alert. Also to support idea 
raised about certification. If it had not been for intervention of higher level certification 
pilot over the one responsible for our EGPWS effort, we might not have it yet. 

Comment : Intuitive situational awareness is the key. Can’t train people to recognize the 
information you are giving them— it has to be there intuitively. Key is to present 
information in an intuitively way. 

Comment : Important to realize whatever is built and put into the cockpit has to be 
integrated into the air space. There have been concerns when TCAS came out that maybe 
integration into the air space w/controller could have been better. Still reports about 
confusion of pilot going off and doing something and questioning what the pilot is doing. 
Realize there are integration issues as well as display issues. 

Comment : Pilots want intuitive information that doesn’t have to be mentally integrated. 
We want the terrain displayed but also want the guidance there— then want intuitive 
guidance because relationship between guidance and terrain is fundamental to pilots in 
terms of spatial awareness. Need to know w here we are going and where we don’t want 
to go. 


PANEL TWO: What’s Next After Predictive CFIT 2-D Displays? 
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Chair - Mike Norman 

Members - Don Bateman, Bill Langdon, Paul Leckman, Charlie Wood 

Mike Norman. Boeing Co .: Pilots are often workload and information saturated in the 
current cockpit environment. More information doesn’t necessarily mean more safety. 
Should provide tactical (what to do) and strategic (why to do it) information in balanced 
amounts. Shouldn’t apply technology just because we can. We should take a 
requirements-driven approach to achieve the best pilot and organizational buy-in. Just to 
put into perspective what we’re doing - Think of the last 10 aviation accidents 
particularly the commercial aviation accidents. Some of the amazing chain of events that 
caused these accidents and now of some of what it would take to prevent 9 out 10 of 
those accidents— institutionally that is not putting yourself in the cockpit and stopping it 
from happening— but stopping it from happening beforehand. I think you will see we are 
getting more into just first order things but second order things-that’s the challenge 
ahead. 

Paul Leckman. Boeing Co .: I am a research pilot from the Boeing Co. I spent last 2 
years trying to pave the way for installation of enhanced ground prox on our Boeing 
airplanes with Don Bateman. Don Bateman deserves every award he’s received. He’s 
done the risky things such as trying to get a terrain database on a transport airplane. He’s 
got a terrain database of the world and got it certified w/the FAA. That is the kind of 
effort that is going to be required for a perspective display. Want to direct an answer to 
Mike Frank’s question. If you have enhanced ground prox now, why would you need a 
perspective display? In my mind, the error avoidance is what’s in front of you— is it the 
runway or hill. The difference if you look at enhanced ground prox, it really does a really 
good job of telling where you should not have gone after you have gone there. With a 
map there is really no reason to get a caution/waming with an enhanced ground prox 
system if you are watching the map. There are certain cases where you can make large 
errors and it goes for quite some time before you get a warning. You are basically 
warning someone after you have deviated substantially. A quick picture can prevent that 
deviation in the first place. You’re improving recognition time; for example if you roll 
out on final and you are so low that there is a hill between you and the runway that might 
be visible. And earlier and inappropriate descent if you have a runway on your 
perspective display and your are at 1 degree off that runway, a descent at that point is 
probably not appropriate. Usually try to stabilize approach at 3 degrees and that 
information always available on the final. In some cases, for example the ??? accident 
where the crew is trying to comply with an ATC request that was inappropriate and may 
have been determined that way through the enhanced ground prox system but a forward 
picture also adds to that. In addition, the display ahead of you shows the azimuth vs. a 
climb angle requirement. The amount of height above the airplane is not as important as 
the climb angle required to clear it. Improved approach stability with perspective display 
will give you similar information as to HUD angle to the runway and the ability to 
stabilize an approach. There have been perhaps not CFTT/classified as CF1T accidents 
cases where you’re under shoot the runway because you let the speed get low or you’re 
trying to descend rapidly as you weren’t aware you were too high until the last minute so 
you ride low close into the runway w/a speed and configuration that was inappropriate. It 
might even help w/over shooting a runway and economically perhaps there is a benefit 
for consistent configurations changes when they are appropriate to get down. Low 
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visibility taxi operations - this may or may not turn out to be useful. Being studied by 
SAE right now. Cockpit display of traffic information - may or may not be useful to have 
forward look at traffic as well as the map display. Where companies install HUDs - there 
is a potential of the perspective display to have similar type of display for co-pilot who 
does not have a HUD. 

Charlie Wood. Douglas Product Division : Have lost 4 friends due to CFTT accidents. 
Ask myself how can a state of the art airplane run into the mountains? I wrote a paper 
and put down thoughts as to why this happens and a What Do We Do Next chapter turned 
into what I call the “Standalone Terrain Conflict Detector.” This is an idea I came up 
with and it turned into a disclosure I made to McDonnell Douglas who in turned filed a 
patent application for it. Basically a device about the size of a lap top computer that you 
can put on any airplane, self contained, with a terrain database. Basically stand-alone- 
one pilot’s idea on how to prevent CFIT accidents. The only reason airplanes run into 
mountains is simply because the pilots did not know where they were— all the rest of the 
reasons are contributory. Why didn’t they know where they were? Before FMS, it was 
very difficult for pilot to determine where they were. FMS was a quantum leap in 
situation awareness because the map display really tells you where you are relative to 
your flight plan. There are some problems with these if you fly a long over water leg for 
your IRS navigation only for quite some time and then you go into country that doesn’t 
have a lot of DME’s you map could shift. I’m talking as much as 8 miles from where 
you really are— don’t think this is acceptable. Already talked about deficiencies in the 
standard. GPWS which again was a quantum leap when it was implemented but it only 
has the capability to look straight down. The EGPWS is also a quantum leap because it 
does give you a look ahead capability and give you its warning of approaching terrain. 
My device, the Standalone Terrain Conflict Detector, relies on GPS for signal. Military 
degrading systems GPS is still accurate within a 100 meters— normal accuracy is around 
10 meters. My device requires accurate terrain and man-made obstacles information to 
be put into database. It requires predictive flight path vector display to show you where 
you are going to be. I feel we need even more warning than the advanced GPWS so that 
pilots can make normal maneuvers and avoid obstacles. First it has to be affordable for 
every airplane owner in the world— that is what is being ask for. First have GPS signal 
giving you an accurate map and I had a flight plan capability to put into this also. Next 
we have a terrain obstacle database which shows you terrain or obstacles that are above 
your predictive flight path vector. In other words, I put the red for anything that is above 
your predictive flight path vector. I put a little 1 00 meter pad in to show possible error in 
the GPS. It is easy to see in bird’s eye view throughout your flight where any terrain 
above your flight path vector is. If you get off course (I say at least 4 1/2 minutes from 
running into obstacle) you get a wake up call. Normally this map display is passive— you 
don’t have to look at it at any time during the flight— it is not a primary flight instrument. 
However, if you approach an obstacle and get a wake up call, then you can look at the 
screen— terrain ahead. You get this warning in time that you can actually determine an 
escape route before the terrain became _a_real serious threat. If you continue to ignore 
this, then you would get a pop up display that would give you a look ahead view of the 
terrain or obstacles. Again, red depicts anything above the flight path vector. Training is 
a big issue w/airlines— it cost a lot. My idea of training with this device is don’t fly into 
the red or your dead. Simple as that. In the device there are indicators in the middle, the 
first little airplane is you. I find I can fly better if I mentally sit behind myself and watch 
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myself fly. Second one is one minute, the third is two minutes away— a function of time. 
As they go faster they move further apart. To do a maneuver you can pull up to fly over 
the obstacles or you can bend your predictive flight path around the obstacles. As soon as 
the indicator turns green, it means your predictive flight path is clear of the obstacles. 
The 3D color graphics really enhances situational awareness. It lets the pilot see where 
they are, see where the obstacles are, and see where the airplanes are going. It is easy to 
see the best escape route. (At this point a demonstration was shown on video). 

Bill Langdon, United Airlines : Let me give you a scenario first. A young lieutenant in 
a F-16 flying off runway - bad weather, low visibility, low ceilings. Take off is a simple 
task of instrument departure following his lead in radar trail. Takes off and about 1 
minute after takeoff something doesn’t sound right. He in a high tech aircraft with 
displays everywhere— he’s got HUD w/instrument capability, radar w/ground map 
capability, regular flight instruments and backup instruments but something just doesn’t 
sound right. He looks up and his primary instrument tells him he’s in 135 degrees of 
bank, 60 degrees nose low and going 450 knots and where did he get the indication— it 
wasn’t from any of these instruments— it was from his ears saying the wind rush- 
something is wrong because I am going fast and shouldn’t be on the departure. So what 
does he do? He rolls wings level through the horizon, puts the nose up 45 degrees, turns 
afterburners on and climbs 35000 ft immediately. What gave him the cue on this is the 
wind rush in the ears. He had all this information presented to him but he got focussed on 
one thing and that’s the radar to follow his lead. What happened to this pilot is that he 
got task saturated. He got in a position where he was not concentrating on what he 
should have been concentrating which was flying a departure— instead of finding his lead 
out there on the radar. How do I know? Because I was that pilot. I was two seconds 
away from impact. Only way I got out was pulling 7G’s. What’s happening is a lot 
information going in but the right information has to be processed. For many years the 
HUD in F-16’s was not allowed to be used as a primary flight reference. It was written in 
our regulations. Why was that? Because human factors are not involved in design of in 
the instrument capability of that HUD. That HUD was put in that airplane to deliver 
weapons. It wasn’t meant for instrument referencing. What I did is some research into 
HUD displays to see what was causing some of this. With Calspan’s help, we designed a 
HUD that was more instrument oriented so that pilots could recover— they had pointers to 
the horizon to get them there-human factors were built in. My first point here is human 
factors is number 1. Got to put human factors in the beginning and other things can 
follow; otherwise, run into a bad situation. Now will talk about needs. Is control flight 
into terrain a problem in the airline industry? My point of view and United’s is that it is 
not a factor right now. United implemented procedures way back to prevent some of 
these things and American did not have the procedures. Problem in airline industry is 
that we don’t talk to each other. We don’t visit each other’s training facilities and see 
what procedures have been implemented and make sure those safety related procedures 
are then brought out throughout the industry. So that’s our fault. CFIT in up and away, 
cruise flight is definitely no problem because mostly fly at night anyway. We are going 
to install EGPWS in our airplanes and all will be retrofitting by the year 2000. I think 
this is a step in the right direction. Would like to see what is becoming terrain out there. 
Would like to talk TCAS. I was flying to South America in Brazilian airspace and I got 
“traffic traffic” following immediately by “descend now.” On my display it comes up 
where to put the airplane to descend now to get away from that person. No radar control 
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where I was at. While I am looking at on EGPWS and other new systems for terrain 
avoidance why not have something in there that tells me where to go. I don’t need to see 
the ground. I need to be told where to go to get away from that mountain. Need for it to 
give me a path. Instead of showing me all these ground pictures which starts a saturation 
of information— got too much information coming in looking at all these displays. United 
is not against developing synthetic displays at all. Think they would like to see 
development go on. Are we going to spend our money to do this? I don’t think so. 
Reason being is that they are looking more for something that’s going to pay off big in 
safety. The reason we are putting EGPWS in our airplanes is because of safety and that’s 
going to pay off good in situational awareness and safety. But are we going to pay 
multitudes of dollars to be able to see the ground? I don’t think so. Unless it pays off in 
safety or cost savings for the airline, then I think that is the only thing United is going to 
look at or any airline industry for that matter. Some safety issues we are looking at are 
clear air turbulence, but CFIT is not one of those areas we are really too concerned about. 
CFIT numbers are really down in the U.S. Where is the concern with CFIT? Concern I 
believe is in the approach landing phase. How can we tie that into a cost reduction 
revenue producer to get them interested in helping CFIT problem. One way is to develop 
systems that can get you into any airport that does not have a CAT 2, CAT 3 capability 
and get you in safely and not have a divert, not have extra fuel. What are pilots going to 
fly? First if you put a virtual display in and you ask captains at United airlines would 
they fly w/the virtual display being your sole source. They would say no way I will not 
fly a virtual display down to a runway and land off it. They want real time data out there. 
Now if you put sensors on and you put sensors showing HUD display would they land 
off that. I would say no again. They want real time information coming into the cockpit. 
Where we get real time information is from procedures. We want this backed up with 
information but not cluttered so much that it takes away that information. This is what 
you find pilots want today. Going to find you have a hard sell with the new stuff. Not so 
much age in reference to computers but age in reference to experience— experience tells 
them that I need to see some real pictures. Believe sensors and virtual technology display 
have to be integrated together. NASA has to be the coordinating body behind this whole 
thing. Have to determine the needs first and make sure we go towards those needs and 
may be put it in to a revenue type approach for the industry to make it appealing to them. 
Hate to see people going along in parallel tracks. Need to find out what technologies are 
out there and see who needs to be contacted to do this so there’s no parallel tracking 
research. Again would like to say (1) human factors is number 1, (2) lots of new 
technology, but need to first find out what the needs are, and (3) how can we make new 
technologies cost driven to produce income for airlines as well as creating safety for air 
carriers of the future. 

George Kaseote, FA A : Going back to Don Bateman— on your gear that flaps down 
problem, can that not be mechanized something like the two low flap switch or the glide 
slop switch such that it will still operate until you get within a mile of the runway? Can it 
not be mechanized off of DME or some other thing? 

Don Bateman. Allied Signal : If we had a glide slope on every approach it would be a 
pilot’s dream. With DME it may be different places other than the runway. Old problem. 
If you take any alert system and you try to make it work going to have to shut it off 
eventually when you try to land— automatically w/o the pilot having unwanted warnings 
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and so on. Wished we could do something. The terrain clearance floor in the enhanced 
view is an attempt using runway position, runway ends, knowing where airplane is and 
doing it automatically w/o the geared flap. 

Comment : In regards to Cali accident - 1 say yes it would have been prevented. I am one 
of Don’s pilots who flew his system. My profound statement on the EGPWS is (and I’ve 
been flying for 43 years) if you want to fly to the ground in that system you are going to 
have to want to fly in to the ground. 

Don Bateman : You don’t have to wait for an alert or warning. 

■Tim Daum. Boeing : Have to reiterate what Bill Hines says. There is another 

community out there who would use this at lower altitudes. With tilt-rotor abilities to 
come in and provide commuter service. It will now open up with the runway for more 
departures and arrivals for the big guys. Because the tilt-rotors operate in that lower 
altitude community and need the greater performance and resolution at lower altitudes I 
don’t think you should push off to the side and really take heart that community will help 
you out. 

Comment : I think on the contrary we are looking for overlapping needs and 

requirements. 

Comment : Given Alaska’s experience with HUD, one pilot said he wouldn’t fly HUDs 
and learned to love it. Given our experience so far EGPWS, the massive situational 
awareness increase all the pilots swear by, and given the fact we are flying essentially 
virtual reality R&P approaches where there is absolutely no conventional navaid backup 
and download and terrain on both sides of the aircraft, Alaska will be very eager to 
partnership with anybody who wants to develop this kind of system and look to get it on 
our airplanes as soon as it is available. 

???. Germany : As vice chairman of ADO committee I presented a video 3D at the last 
committee meeting and it resulted in ARPA strongly supporting the development of a 
terrain and position awareness system. For example, projects such as the 3D flight 
guidance display system research and ARPA ultimately believes the requirements and 
installation of EGPWS would not be required if such a system were to certified and fitted. 
As a pilot who has flown the system, it is not supposed to be a 0/0 system. The 
possibilities of a whole system having to implement fans, ADSB, TCAS, or just having a 
hazard warning and escape possibility within the system. Also with the TCAS possibility 
has a chance for the airlines to make real big money if installed this on the economic side 
as well as the safety side. 

Tom Leard, Honeywell : If 3D displays provide the opportunity or terrain displays 
provide the opportunity for a line pilot to have category 2 capability without re- 
certification every x number of months, without calibration of equipment every x number 
months, that is a tremendous ability and mission completion capability. I think if those 
things came to pass because of technology integration in the cockpit, the economics 
would be immediately obvious to every operator. Seems like a tremendous economic 
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incentive to make this work. Whatever the right mix of data is to making the cockpit. Ala 
- what are the right requirements. 


Comment : I agree with you 100 percent. What stands in the way of some of this stuff is 
how far is the pilot going to go with virtual displays and that kind of thing . Because it’s 
nice to tell the airlines, yes, we have this virtual display that will get you in anywhere. 
You don’t have to have a category 3. You can fly a flight path through the sky. But 
you’re going to have a lot of resistance from the pilot force and it’s going to be hard to 
overcome that. I am not saying that it’s not do-able, but if you can make it cost effective 
to the airlines to do that than ALPA has to help sell it to the pilots also. 


January 28, 1998 

PANEL THREE : Just Do It - Can We or Can’t We? 

Chair: Tom Leard 

Members: George Boucek, Phil Brooks, Bill Corwin, Doug Trumbull 

Tom Leard. Honeywell : I put together a talk about issues that have surfaced at this 
workshop thus far. Areas of certification. ..The panel will give us their perspective as to 
what is ready now, what isn't, retrospect issues, and certification obstacles. 

I am a Human Center Design Specialist. The primary focus is on business of human 
design. ..Really fits into area that I have been working on. In that background, reflecting 
what we are involved in. I worked as a test pilot at DER, Long Beach, California. If I go 
further back I can include time spent in a variety of... somewhere back there is working in 
the training business. Training is one of the key pieces of a human design process. 
Variety of typewriting. I also spent time in the U.S. Air Force. 

George Boucek. Boeing : I have been with Boeing 30 years. Set up human factors plan 
for.. .777 program. I am a Program manager for the FAA sponsored work on crew 
alerting which resulted in ICA system and synopsis and checklist programs. I want to 
expand on what Dave Foyle said and in the context of this panel. The answer I would 
give is yes because technology is there. The real question is should we? What are the 
requirements to find out what is? Look at integrated technology of the flight 
deck. ..retrofit, employ across customers. ..whatever the marketplace will define. What 
should we be doing still remains unknown. What Russ has asked is the requirements 
given vs. solution given approach. What I mean is the actual or more closely system 
specifications requirements. I would define autoland system. To land +/- 27 feet of 
runway centerline. To reduce aviation safety is not a requirement— it is a goal. We need 
to make goals and requirements separate terms. It is a goal to increase safety and reduce 
by 80-90% depending on timeframe, but if we do that in a system different than this it is a 
system where the pilot is the critical component , which we then work what Tom alluded 
to— a crew system concept. Initial building blocks are to determine what we have to do 
with the crew to achieve the goal we are looking for. Like Foyle said... decide what 
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technology to use to implement changes/functions that the crew needs to work or be 
critical component. Defining those requirements/functions have to be our upfront effort. 
We can talk a lot about technology and what exists, but until we determine the function 
we want to perform, the technology. ..we can’t do a good job in talking about technology. 
Until we determine the functions that we want to perform with technology the 
functionality or better yet the marketplace can determine what technology is applied. Can 
do same functions in GA, rotorcraft, military and commercial by vastly different 
technology. First I have to determine what it is you want to do. [Showed cartoon]. I 
leave you with the words: we have to determine the requirements, but they are not really 
the goals. 

Bill Corwin. Honeywell : This should be a requirements-driven program. On my flight 
out here, I looked at a report from the ASRS program at NASA about controlled flights 
toward terrain. What is new and different about control flight toward terrain? With 
regard to what Don Bateman said about lack of MS AW warnings in ATC software 
around the world. Looking at descents. Where you descend from altitude -between 10K 
and the runway - and you haven’t rolled out onto the runway heading. There are a few 
airports where this is a problematic (Las Vegas, Tennessee, and Portland). It is 
interesting to note that we ought to be thinking about installing the same software into the 
controller’s workstation that goes into an airplane. Speech recognition technology is not 
far away and should be installed on EGPWS. The controller should be aware as well. 

What is the motivation for reducing CFTT? First and foremost, the tragic loss of life 
associated with it. CFIT is bad for air carrier business. Litigation settlements are very 
costly. Yesterday, the fellow from United said they were not interested (as a principal 
thrust) in CFIT avoidance right now. My reaction is - Until you have one (CFIT 
accident) in the near future. Russell Chew of American Airlines has written an argument 
about the business cases of why airlines do things— revenue enhancement, cost avoidance, 
competitive position. Revenue enhancement: Will equipping the aircraft with PFD 
provide the carrier a new capability? No. Cost Avoidance? Yes. Settlement associated 
with litigation is prohibitively large. Is it a competitive position? Yes. AAL is 
equipping it's fleet with EGPWS. The paying passenger public is getting smarter. 

My homework assignment from Lynda was to answer five questions. Integration of 
synthetic vision display with existing displays. I am taking a technology perspective on 
this. Can it be done? Yes. Why not ground portion of the ADI as we’ve seen in the 
demonstrations so far. Can it be done in existing CRTs/AMLCDs? Probably not, likely 
it’s cheaper to replace display unit and symbol generator. What is ready now? The 
terrain database. I stand corrected per what Don Bateman says that is not ready. What 
isn’t ready besides terrain database? Perspective scene rendering on avionics grade 
displays (not what we’ve seen today). Retrofit of Synthetic vision display into existing 
aircraft requirements. The FARS are not mystical, not hard to interpret. The scene must 
be accurate and correctly registered on the actual world view. Certification obstacles. 
The process itself can be an obstacle. Clear criteria must be identified. The dialog 
(applicant/FAA) must be candid and timely. May be great that FAA is re-addressing 
themselves to process of certification. Have to have candid dialog. Can we do it? Yes. 
Should we do it? Yes. Technology will save lives. Technology will be cost effective for 
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the airlines in the long run. We should do it with all possible haste. I am an avionics guy 
and Don Bateman is my hero. He has saved so many lives. 

Phil Brooks. Allied Pilots Association : I am representing the Allied Pilots Association. 
Ladies and Gentleman, American Airlines through which I am a pilot for feels like this is 
very important moment (as was mentioned on December 1 1) in history. We also think it 
will happen soon. I ran across a quote from Gerta, “Whatever you can do or dream you 
can, begin it. Boldness has genius power and magic in it.” The phrase just do it — I would 
say must do it. When talking about pilot requirements this is what we believe: A pilot’s 
vision is a cornerstone upon which everything in aviation rests. So combining both an 
intuitive perspective view of terrain using real world visual cues with visual highway- 
type display of guidance is absolutely paramount because managing the relationship 
between terrain and flight plan is the fundamental responsibility of a pilot, therefore to 
the extent practical alpha numeric or arbitrary symbology can be eliminated. Since this 
information requires mental integration which is distracting the pilot from the primary 
task of constant intuitive spatial awareness. In a transport circumstance, occasional pop- 
up information reflecting graphic values as opposed to alphanumeric or arbitrary 
symbology which is phase of flight dependent is acceptable to a pilot from a spatial 
awareness point of view. I have a video that will be shown in a side room. 

Doug Trumbull. Entertainment Design Workshop : I have an aviation point of view. I 
was a photographic effect supervisor on the 2001 Space Odyssey - 70mm cinerama. On 
this giant 90-foot curved screen you felt like you were in the movie. This experience at a 
young age altered my interest in immersive experiences. I have recently been 
participating in digital revolution. We have been doing this in the movie industry with 
computer graphics. Daily we are superimposing real images of real life situations with 
computer graphics and merging them together seamlessly. A recent project I worked on 
was an adaptation of a flight simulator in the Universal Studios ride— Back to the Future. 
This was a flight simulator for 8 people surrounded by an 80-foot hemispheric screen 
with extremely high resolution displays. It is an extremely powerful immersive 
experience. The epiphany I had while working on the Back to the Future ride by 
presenting anyone with hemispherical display with image that replicates human views. It 
is a very powerful human stimuli and responses. I have always been interested in 
continuing to develop this technology. Over the last 3 years I have been with IMAX. 
Been developing advanced 3-D high quality system in domes and flight screens. Also 
been putting IMAX 3-D cameras on shuttle for the last 4 years. Familiar with aerospace 
business entertainment. Developing six passenger simulation entertainment project 
which will have real-time graphics, a hemispherical display with electromagnetically 
actuated motion that is quite powerful. Our business everyday is just do it. We don’t 
have the FAA to tell us we have a good idea. We can buy a computer and component and 
put it together. We just hit the ground running. To help pilots immediately, we need to 
be able to cut through the bureaucratic red tape. We are regularly using SGI and Unix 
machines as well as Windows NT-platforms. I believe from my point of view that what 
pilots need in order to have what Phil says as intuitive interface is an image displayed 
which replicates the reality. He doesn’t need an interpretation. If CFTT occurs because of 
loss of visibility, i.e. he does not see out the window. It seems natural to place a view out 
the window, not in front of the display. Most of this needs to be implemented into 
retrofit. I am familiar with projection technology in existence and some in development 
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at Honeywell. I feel strongly that I haven’t seen anything that you could retrofit into an 
existing fight deck. You can do a HUD, but a wide-field display is another challenge. 
The only solution I know so far is to encourage Microvision’s work. I feel like there is a 
chance that this new laser-based retinal injection concept which can deliver a very high 
resolution, wide view display without intruding on cockpit or pilot. It is by virtue a head- 
mount display which only weights a few ounces. Doesn't intrude on comfort. This may 
be the answer to getting displays up and running in a cockpit very quickly. Graphical 
systems to display terrain, weather, highways in the sky and flight path. I also know in 
the world of computer graphics - stereoscopic perception gives whole new awareness 
with 10- fold increase in perception and awareness. Can be achieved with laser based 
HMD. A ,J. Yarmie described those technologies. I think eyes out is the way to go. Also 
hyperstereo - where you increase from normal human interocular distance of 2 inches to 
any distance you want which allows you to extend way out. 

Ouestion/Comment : Mike F. of United Airlines, (addressing Corwin from Honeywell) 
United airlines is very interested in CblT. We are extremely interested. United Airlines 
is the first airline who voluntarily committed to installing enhanced GPWS on its entire 
fleet. United Airlines has very vigorous training that stresses the avoidance of CFIT 
occurrences and procedures to clear terrain. We are acutely aware of CFIT problems and 
we put all the new technology in our airplanes and train to avoid CFIT problems. What 
UAL is saying is we don't see any technology that would improve our CFIT avoidance 
procedures anymore than we have done. 

Ouestion/Comment : George Kaseote of FAA. One gentleman said apply now because 
certification process takes so long. I don’t agree. A lot of times people submit 
applications without the data which means we are stopped. 

Tom Leard : The point made by a panel member is of constantly carving new ground: 
display integration, display processing, information processing. That data needs to be 
submitted at an early stage with meetings way up front with appropriate FAA engineering 
offices and both parties recognizing roadmap to certification. It follows through 
certification. It follows regular updates of FAA team. In the field on human-centered 
design, the data that’s taken may be a collection of experienced cross-trained pilots to 
evaluate what’s put together into the process - that takes time. I think FAA is very 
interested in cooperating but answers aren't written in a book. 

Bill Corwin : I said 2 provocative things. First, let’s go back to the comment made by 
the gentleman from United. No offense was meant. What problem and how are we going 
to solve. ..agreed. Honeywell about 4-5 years ago in pursuit of enhanced situation 
awareness system was struggling with issues that Allied Signal has successfully struggled 
with. Honeywell was left with a situation where we had concepts in place but we felt that 
it wasn't in the best interest to invest time in terrain database issue 5 years ago because of 
the certification hurdle. Internal decision bases on previous experience with the 
certification process. 

Ouestion/Comment : Jim. I want to reiterate what George Boucek was saying. What 
requirements? Our we letting technology drive the requirements? This concept has been 
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around 50 years and why aren’t we using it now. We realize technology doesn’t meet the 
requirements but we haven’t addressed what the requirements are: accuracy, redundancy, 
etc. Once these are defined and we know the requirements we can say we have the direct 
input on benefits. In lower altitudes, definite benefit for such a system. In getting those 
guys out of airspace and letting airlines operate more efficiently that would answer the 
question is there a direct benefit. 

George Boucek : Thanks Jim, but we have to go farther. In order for us to sell the idea 
with customer or internal management, we can't use the words “I believe” or “pilot 
believes”. We have to be data driven. We have to generate data that shows benefit of 
technology or functionality that we are trying to apply. Opinion that we may have vs. 
opinion management or buyer may have. If comes down to opinion vs. opinion then 
management and bean counters win. 

Tom Leard : Regarding technology driven. An example: A controversial piece of 
technology with many cockpits is the flight management system. We were so desperate 
as aviation was expanding with the jet age to get around carrying a navigator around. We 
put in latitude and longitude information in a self-contained box. Game for doing that 
because it allowed us to get started. We were game to use the navigators accountant 
device because it cut down on economic expense. Now we are looking for another 
solution because was not a perfect solution. 

Phil Brooks : Amplify what George has said. The reason (for the system) in the airplane 
is for operational expedience and efficiencies. Under the context of just do it there are 
two hurdles: Certification and Justification. We have to be able to develop cogent 

argument which gets brought to those who make the business decisions. Make your 
business a better bottom-line proposition. That is what I need to take with me. I suggest 
in addition to prototyping, certification, and documentation there should also be cost 
argument development. Dave Foyle's information is what we need to jump that hurdle. 

Ouestion/Comment : Requirements vs. goals when designing aircraft. I work on B-2. 
You set up parameters called requirements. When we look at safety there were specific 
requirements and safety for the B-2. What are the requirements from Boeing for 
designing a plane for safety? Statistics show that CFIT is the number one thing - which 
may or may not be true. Any specific numbers that you say here is our safety 
requirement? From an economic point of view - Any business operates given this is my 
requirement. Without requirement it is come and catch as you can. Has Boeing put out a 
requirements list for safety? 

George Boucek : Bottom line requirement for design is don't let system be less safe. The 
goal is to make it more safe. The goal is anything you do in the flight deck is done with a 
safer system in mind. What we look at is what functionally we can demonstrate that will 
make the system safer. 

Ouestion/Comment : 20 years ago I worked statistics and safety. It has come down. I 
started looking recently because I lost a friend. If you use a goal that we don't degrade 
safety-is that why for 20 years there has been no improvement in safety? 
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George Boucek : I disagree that there has not been improvement in safety. In fact, in the 
last 20 years it has improved greatly. It has improved in areas of mechanical systems 
especially and air traffic systems. That is why the US domestic system is so much safer 
than other places in the world. 

Ouestion/Comment : In the last 16 or 17 years, fatalities have stayed constant. That is a 
fact those improvements occur before most people have been involved. 

Ouestion/Comment : Is your question - We have this goal to increase safety. But 

George says we can not do without requirements. Doesn’t the question get to be— how 
do we take this goal and from this derive the series of requirements? 

Ouestion/Comment : What are present requirements for safety? And if there are none 
shouldn’t there be some? And who makes them? 

Tom Leard : That is why we are here. A1 Gore Commission, looking at industry, 
reflecting on statistics show it is a mechanism to provide incentive to go do something 
about flattened curve. This NASA process is an attempt to go do something about the 
curve that has flattened out. Have national goal established as an ambitious national 
endeavor. Our challenge is to influence all manufacturers to do something about making 
it happen. 

George Boucek : A system that has 10K, 20K existing airplanes has a lot of inertia. 
Look at CFIT accidents between glass cockpits and analog cockpits and there’s a 
difference and improvement, It is not the lack of putting safety requirements, but identify 
areas in which we can improve safety and crew performance. Identify those and what we 
can do to do that and then accept safety benefits we get from it. 

Ouestion/Comment : Glass cockpit statistics. Shouldn't one thing be set up quickly? 

At the beginning you brought up goals of Gore commission and said that’s not a 
requirement. Why can't there be requirements (like stress on the hull) and set this up as a 
requirement? Why can’t we make that a requirement on the design of the aircraft? 

George Boucek : Give me the metric and I'll set up. Give me the metric for the 

requirement. 

Ouestion/Comment : There is some metric on this is that we have seen several test 
results of synthetic vision flying - flying on a highway. Phil has results that George 
Hoover did. Germans did good job of testing synthetic vision and it works. Barrows’ 
showed tracks that they flew but it’s no design parameter, but a performance parameter 
that has been measured. We know there is something that works. There is an integration. 
The goal is to improve safety but we need design requirements. Germans have done a lot 
of work trying to find out what the requirements are through studies over the years. They 
evolve their requirements out of tests. There is a difference, there is a goal (which is not 
a requirement). A requirement falls out of design criteria. You can have 100K ideas to 
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increase flight safety and they could be resolved into requirements - one could be 
synthetic vision. But the goal is flight safety. 

Question/Comment : I want to add some thought about difference between synthetic 

vision and existing enhanced GPWS. By chance, I was looking at an FAA report by 
human factors team on interface between human crews and modem flight deck. If you go 
to executive summary of requirements it says the FAA should encourage the aviation 
industry t develop and implement new concepts to provide terrain awareness. Crews 
would be glad to have terrain information while enroute so they know where to go when 
all engines stop. Difference between EGPWS and what can be implemented if we had 
whole world terrain depiction on aircraft. This is one of the things required on FAA 
report. 

Question/Comment : What can really6 mess up the measurement Eastern accident over 
the Everglades. If you have synthetic vision up there it wouldn’t work. You still have 
.03 sitting out there when you have an accident. Hard at those low numbers to get a 
measurement back out of it to say something is going to work or not. Direct to cost 
effectiveness and get enhanced awareness from that... 

George Boucek : What Phil said is that one of the key elements that come out of 

NASA/Industry teamed work is the data that would show us what effect of putting the 
technology in there. If I have function to land at lower minimums at runways (Fields) 
ends that are not certified, Can I show that pilots can do that task? And what would it 
buy me if I did get that function? If I can generate those 2 pieces of data then I can 
convince someone to put function onto an airplane. 

Question/Comment : Mike Snow of Air Force Research Lab. In the human factors 

community we have a number of measures of situation awareness. I would contend that 
what we are trying to do in simulators is put pilot in situations where ground impacts are 
much more likely and correlate SA measures with ground impacts. Show decrease SA is 
greatly correlated with ground impacts. Then, hopefully in flight test show that a system 
that greatly improves SA would then greatly reduce ground impact. 

Phil Brooks : Mike I take that as an observation. I didn't want to interrupt you. I think 
there are two points to Bill and George. George’s amplification of Bill’s comments. I 
believe the success or failure in terms of industry is quite literally where the rubber meets 
the road. If we can increase the acceptance rate of aircraft onto the runways and all the 
efficiencies achieved operationally that result from what Bill says that the safety follows. 
The second point about Bill’s comment about Eastern flight relates to George Hoover’s 
research. I think that based on my investigation.. .[showed chart of first aviation factors 
program].. ..in case of Eastern if we go to motion parallax.. .human eye naturally goes 
there by evolution ....eye goes to target, if on 3-d display in the cockpit if you saw 
motion. ..your eye would catch in a cockpit. Important thing regarding synthetic vision - 
Impact site of Cali crash - our crew on that airplane made erroneous turn to East and 
corrected pack to SW to intercept their course. Unfortunately, there was intervening 
terrain. First Officer leveled wings and executed GPWS maneuver. If that airplane had 
had some vertical guidance about ridgeline available in cockpit, the pilots would have 
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continued turn for a few seconds and would of slid off shoulder of that ridge. That was 
crucial information that was lacking. 

Question/Comment : Another subtle safety implication to displays not mentioned is as 
we transit more and more across state boundaries— we will have pilots flying in unfamiliar 
territory. Needs to be considered another aspect of increased safety. 

Panel : Excellent point. Being on the road. It is nice when you can stay someplace more 
than one day in a row. If terrain were accurate with margins built into Instrument 
Approach System, that may make a difference in those unfamiliar places that we don’t 
have to go to. Any other comments? 

Russ Parrish : Thank you panel. 

PANEL FOUR: Databases 

Chair: Ron Bolton (NOAA) 

Members: George Chang, Mario Chuliver, Wolgang Kubbat, Bob Severino 


Ron Bolton : I put in documentation about different resolutions and accuracies by using a 
strawman for obstacles in terrain that will be held in Montreal, Canada. 

Bob Severino : Covered points in last presentation to reconcile accuracy for new test 
data. There is about a one year processing where data will be post-processed. 

Mario Chuliver : I work with ADR, Inc. Corp. which is part of General Dynamics 
Electronic (GDE) systems. We were purchased from GDE a year ago. ADR has been on 
opposite sides of the spectrum. We have been talking about the database in the area of 
level one and level two. We have been working in the area of sub-detailed area five. 
Producing land bases for civil engineering and sub linear/subfoot. You can obtain 
accuracy if willing to spend money to obtain. Our interest in participating has been to 
gather an idea from all of you in regards to what exactly is quality and accuracy of the 
data that you deem necessary. Is it that the consensus that we need data in the area of +/- 
...2 meters vertically. I would like to leave this meeting with an idea of where the whole 
industry is going. In the mid 1980’s we were involved in the stuff and analysis of airport 
extraction which was not by any regulatory agency of the US, but in all cases by civil 
engineers, but engaged by love for airport management. We worked out a mathematical 
model to produce this kind of information. We felt that the type of approach for what we 
are trying to achieve now was produced in approximately 15 airports. Most were county 
level airports, however we did study for one of the runways in Laguardia, Dover Air 
Force Base and others. Some examples employed photogrammetric methods which was 
the most important study that we carried out. This was the type of information that we 
provided. We used digital orthoplots, used vector... facility wide GIS. The process was 
carried out by acquiring leaf-on aerial photography. We provided GPS to area control in 
order to support land base. In several cases we set up monumentation to be left in 
facilities including the airspace studies and transition and chronicle surfaces as well as 


26 



horizontal surfaces. Some of you may be familiar with the different surfaces to be 
studied, some have distinct weight, length and ...[showed chart], ..magnitude of the 
intrusion. The primary surface of the boundaries is that it is a rectangle. The other 
parameters show where they begin and end. Down to accuracies one foot vertical for spot 
elevations, [showed chart] These were the items measured: buildings, trees, and 

powerlines— anything manmade and suspected of intrusion in an approached surface. 
This is a chart that can be expected with different types of imagery. They have the 
capability of yielding in areas of 3". ..which available to civilian community within 6 
months. The company has launched a satellite with 3M ground (been out for a month 
now). In a couple months there will be another one. With a one meter resolution in space 
imagery [showed chart]. What is runway studied and approach surface, etc.? This was 
the type of study that we produced This kind of experience could be applied to the type 
of endeavor that we are working at now. New tools to do this type of work. Technology 
becomes available. What you mention in regards to digital camera is something we are 
interested in. That in a nutshell is what we have been doing. I would like to see 
resolution in order to satisfy your requirements. 

Wolfgang Kubbat : I have a 30 year background in aerospace and in issues there were 
control theory and safety. In industry I ...a control ...supersonically flying disable 
controlled. Control theory in order to stabilize and safety. Then I had a love with 
helicopters so I flew digitally controlled. I then inherited the tornado problem— tornado is 
a low level flying aircraft being flown by the Air Force of Italy, Great Britain, and 
Germany. It is in serious production already. I left industry after I designed a control 
system for.. .issues control system theory, highly agile aircraft and safety. Referring back 
to the tornado, it is an airplane with an automated terrain following system. I admire 
those people who sit in the F- 111 and don’t know what the system is doing and they go up 
and down. It is visualization. I accepted an offer to be in charge of Institute of Flight 
Technology. It was a minimum obligation to teach 8 hours. I told my wife I could teach 
singing— she said no. What kept popping up in my mind was safety. You really have to 
do something with better and faster information.. .another clock.. .glass cockpit didn’t have 
much they need pre-processed information and.. .Have close ..VDO.. .let’s visualize the 
outside world and start with picture of primary flight display to overcome major problem 
of today’s CFIT. Give primary flight display to pilot and added.. .the pilot needed more to 
do. One issue about taxiing— if complete display philosophy which can be retrofitted or 
installed in new airplanes. I started to do the job as complete as possible, so we got 
engaged in the database problem. We converted this database into a WGS84 but did not 
start test flying without validating. We built a DPS and GPS which was haste correction 
and are in the area better than 10 cm. We did not flight test without calibrating, however 
the purpose of this meeting I will say I am a user looking at the data problem rather 
than. ..detailed speech later from ??? Again, the safety issue is very overwhelming. We 
are talking safety in terms of handling the database. 

George Chang : I am George Change and what is in my mind right now is sets of 
aviation data information from three professionals. I finished Engineering school in the 
mid 1960’s and went to Boeing. I then went on to work for the Navy and two universities 
teaching. I spent 2 years with the FAA HQ. I took an early retirement and am now an 
independent consultant. I want to shed light on some things. You’ve learned a lot in this 
room and elsewhere. The aerospace world is complex, whatever we technologists do 
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database is included. We need to keep in mind that we need to satisfy and get buy-in 
from two parties (the pilot and aircraft controller). How do we start? You might ask 
what kind of standards are in all this. Standards for aeronautical information —you can 
pull through operation requirements and existing. You can define operation requirements 
based on mission. Is it nearly CFIT?. Defining a mission you can do one at a time and 
get some work. You take care of human factors. You do all kinds of things then you 
may want to say I do all these things. Is it affordable and cost effective especially for the 
same theory. The bottom line is not because they love something, but finally I suggest 
that you might have better understanding of how FAA works— the organization, people, 
culture a lot of that misunderstanding is hurting people’s morale.. The FAA has many 
functions: 1) to promote aviation, 2) provide.. .3) certification of air equipment , 4) 

provide flight standards and 5) security mission. Finally I would like to venture to 
suggest for consideration that we can use elements of all these technologies to formulate 
business strategies. 

Bob Sutton : I help the Program Office. It really gets to the issue when put mission of 
Orbiter... Alaska is missing. Anybody know what is going on with getting Alaska 
information? I ask the question because somewhere between... happen in that state. If our 
goal is 80-percent we need to know Alaska. 

Panel : There are now a number of efforts taking. ..technology and using airplanes to take 
those sensors and scan parts of states. What I don't know is if the scientific community 
has approached sources of funding approaching Alaska and the FAA (not only from space 
but learjets). 

Panel : In area of commercial there are no blind areas on that type of coverage. It will 
come down and become immediately useful. For example without the need for additional 
ground control or other support you can create accurate DEM from stereo-imagery so 
there would be another possible source for information. 

Ron Bolton : There are some 8,000 procedures which I have in my books, 90-percent of 
which are FMS approaches that deviate from minor to major ways from the approach. 
We don’t want to do this in this database, whatever we decide to do to should help the 
pilots. One suggestion I have is since this is not to land aircraft per say, but to aid the 
pilot not to go into CFIT, look at the different phases of flight and resolutions. A lot of 
you have studied the problem and I would like to discuss what the panel and you feel. 
We don't have to have just one database. If you're going to fly airplanes using a database 
to prevent CFIT and get general information. Is this a good enough strawman to get us 
started? 

■Tore Baker. Free Flight : Do you have a synthetic vision display and are using it? I 
want to let Bob know there is data available for Alaska. It is the same stuff we are using 
in the U.S. which you will see tomorrow. We can cover the whole planet with 30 arc-sec 
data on one CD-ROM and have their space. You have 15 minute data which may be 
accurate for CFIT, but seems thin to me. I may want to know roughly what the terrain is. 
In the terminal area I don’t see unless there’s some weird terrain on the airport. We are 
planning on using a 6 second demonstration and as you get higher 15 sec and ideally in 
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route below 10,000 feet we would lose speed limit. If above 18,000 feet it would go to 5 
minute data. 

Tom Leard. Honeywell : Interested to hear two approaches as to what is the right 

amount. How accurate? It’s pretty impressive that we think with 30 arc-sec data. 

.lore Baker : Can do that with just over 5MB. Flying across the ocean may be more 
interesting and inexpensive for us. 

Tom Leard : How accurate is the tradeoff? How readily is it? How much space and 
memory is there to carry around? 

Panel : We'll have to see what happens as a result from the Montreal Conference. 

Ron Bolton : Do you use the same source? 

Panel : No. We probably need to think of multiple ways to do this. For a week I looked 
at all data from 300CPU's. The point is that it is a considerable job to process all the data 
just to get to a resolution of 15x15. It’s a considerable job to go up in resolution and talk 
about satellite collectors. Like Bob mentioned, resolution is an important issue. 

Comment : Another piece of metric is world wide operation vs. one or none. We see 
remnants in our navigation. I’ll take it that way so the crew don't have to change over. 

Ron Bolton : That is a valid consideration. We have to make it easy. 

Bob Severino : The overarching objectives is to establish a database, a focus area and a 
clearing house. The idea is on developers who have different interest. 

Ron Bolton : Accuracy and update are problems. We know there are reliability problems 
that’s why we can use the strawman for accuracy. 

??? : It is very commendable and important to feel there is to much of a push for a final 
approach and all the way through CAT 1, 2, and 3. We push beyond what it can do. 
Afraid we are locked in a box if we think we should do taxiing through the gate. I hope 
the synthetic vision effort does not blind itself. 

Ron Bolton : It would not be that expensive. I left literature that would let you survey in 
a few hours all airports and be accurate to about a 1/2 a foot. The database needs to be 
updated. Can not assume that as gross as they are that they keep updating them every six 
months. They are obstacles that are changing. You all should understand that fantastic 
changes every cycle. The 56-day cycle is well thought out. 

Wolfgang Kubbat : When I am listening to this discussion I sometimes get lost. I think 
somebody has a goal here to produce a super perfect database covering all issues in the 
world. I think the world is different. If for instance an airline wants to establish a new 
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road. Somewhere in the world to Pedro??? in Russia and Pedro??? does not have good 
database--what would I do if I promised myself this is profitable route. I would go to 
Pedro??? and take my GPS, star shooting equipment and would produce my own 
database. I could calibrate. If you think you have promised yourself that there is an 
airport that I can make service to and gain profit at, not much money or risk to extend 
database to an accuracy which you can land on under category 3 in near future. This is 
what I experienced with the flight test we did. I was lost in this discussion because no 
one in my opinion would land in a spot that he has never been without surveying the area 
or checking the integrity of the data. 

George Chang : I will be brief. With all due respect for the panel chairman and with a 
flight standards background in mind. I would like to suggest that these numbers on charts 
deserve much more scrutiny. I disagree with many, but not all the numbers. 

Comment : Another part or side is depending how the database is incorporated in the 
flight management system or autopilot system. Depending if you want to shoot 
approaches with it. You have to certify it to be fail operational. This means ten to the i 

minus nine or ten to the minus 12. You have to make data link operational. Thinking I 

about databases somewhere down you have to be certified if you want to fly with it ten to j 

the minus ten to ten to the minus twelve. Depends on approaches you want to do. Can be ! 

a very huge problem. This should be how the database is incorporated into flight 
management or autopilot system. Not only does the data have to be good but fail-safe. It 
is much bigger problem than putting to one meter or two meters or things like that. 

Russ Parrish : Ron, are those proposed standard available in the back of the room: 

Ron Bolton : Yes, I have given those to Lynda. I want to say one thing that you may * 

think these charts are off-the-wall. The figures are kind of off-the-wall, but the references 
and ideas for needing to do standards were developed after these particular readings . 

There is one where the two references are to George Boucek and representatives from the 

Volpe Transportation Center. The effort was to start a discussion. Everybody has gone 

around in circles. It hits me very hard that the last gentleman who brought up ! 

certification. That is a very important part. As producer of charts, for me to think there 

are literally hundreds and hundreds of flight management systems really not flown by the 

FAA - leaves me to say I have great concerns about this kind of data because people 

might certify the system and not the data. That would be so dangerous. To give you an 

idea, I turned down publishing a procedure (which is probably illegal for me to do) 

because the NDB that came in surveyed was 800 feet off and 400 feet to the left on the 

runway - right on a road. It was misplaced. No sure way with GPS or any other system 

that everything is right. The only thing is if somebody should check that data (an 

authority) and certify that it is safe data. If we go in throwing data around we will be in 

serious problems very quickly. Thank goodness the FAA flies the rest. I am concerned 

that they are not flying the FMSs even though competent people produce them. The 

point is anyone can make a mistake and somebody should certify the data. When we go ! 

the for the next step forward into visualization which will really help not make mistakes, 

situation awareness will be enhanced at no hand, even if we do a gross system. I think 

the data must be checked. 
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PANEL 5: Advanced Vision and Sensor Technology Session 

Chair: Thomas Campbell 

Members: Ron Bolton, Richard Bume, Malcolm Burgess, Mike Frank, Richard Kerr, 
Paul Leckman, Dutch Neilson, Mike Norman, Vic Norris, Alberto Ortiz, Merit Shoucri, 
Peter Symosek, Dick Zeylmaker 

Thomas G. Campbell. NASA Langley : The panel consists of participants who have 
experience in Sensors, Sensors Fusion, Flight Operations, and Data. Approach of what 
we want to take on during the panel session is to address the main question what is the 
role of sensor technology in the synthetic vision element of the aviation safety program. 

Mike Frank. United Airlines: I am from the office of Flight Operations in Chicago. I 
will be talking about the Airlines view on this technology. Technology - we are not 
building anything we are your customer. The airlines buy this stuff (technology). I will 
give you a quick insight on how we buy this stuff - our acquisition process. Process on 
buying this technology - addressing user requirements. Helicopter community has 
different requirements. We need to make a business case in the airline business for 
everything we do. I review a lot of things bought for the airlines. Cheapest and most 
efficient way is what we look at. Pilot associations (unions) are not customers and do not 
own a checkbook but the airlines do and it has to go through a financial department to get 
approved. Pilot unions must provide more of a business case than an emotional case to 
get SV technology on the airplane. New technology does not produce revenue but may 
save cost. It is hard for a financial person to understand this. Difficult to justify cost- 
savings but easier to justify revenue generation. Cost savings are not real and they cannot 
see this. Just because we justify this but that doesn't mean we are going to buy it. 
Airlines come out with a capital budget every year for improvements. And even if we 
justify synthetic vision for collision and avoidance (the cost less than the return) and we 
got approval for the capital budget. This does not mean we are going to spend the 
money on that because every bit of money in the capital budget has to compete with some 
other organization or division in the company. Capital budget fluctuates. If fuel costs are 
low, capital budget is big and vice versa. We have to make a very good business case for 
this. Not just acquisition costs, but there are other costs associated with obtaining a new 
piece of equipment. Here’s a chart for cases of dead-end technologies. 

Dead-End Technologies : 

MLS (Microwave Landing System): FAA spent billions but could not make a business 
case for this. 

ESAS (Enhanced Situational Awareness Systems) 

ELS (Electronic Library System) 

ACAS (Aircraft Collision and Avoidance), BCAS (Beacon Collision and Avoidance), 
TCAS (Traffic Collision and Avoidance) systems: To solve problem of mid-air collision, 
government working on a program (ACAS, BCAS, TCAS). The name changed over the 
years, but still working the same problem - preventing mid-air collisions. 

TCAS is on airplanes because it was mandated in 1988. We are the safest transportation 
mode - fewer fatalities per accident mile. Hard to quantify safety devices - this is why 
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TCAS had to be legislated. Safety does not sell - legislation only required that large air 
carriers equip. The commuters and the cargo carriers were not required to put on this 
safety device. Last year the commuter industry was required to put on TCAS but they did 
not do it voluntarily. Safety has to be legislated on the airplane to install safety devices. 
So what does not sell - low altitude flying through canyons and we don’t do that. There is 
a FAR that says you cannot fly below 1000 ft in congested areas (500 ft in uncongested 
areas) and you should not be close to the ground. Talked about database systems whose 
sole purpose and intent is to avoid CFIT by presenting mountains. This is a safety issue 
and cannot make a business case for this. May end up in the dead-end issues. NASA has 
a lot of good programs, dollars and people and good potential for us and the community if 
we can get everyone focused in the right direction. Someone earlier from Honeywell 
mentioned about the Cat II approaches would we buy that? 1000 percent correct, but he’s 
the only one that mentioned Cat II approaches. Cat II is a problem in the airline industry. 
If we can get to airports in low weather visibility conditions then we can enhance our 
throughput and increase our revenue and this is a big benefit for the airlines. No one 
except this gentleman has mentioned putting terrain databases in the airplanes so we can 
go to Cat II minimums at all airports and no one thinks this is a problem. For instance - 
Dulles airport has 6 runway ends and 5 ILS approaches and one Cat II/III approach. And 
as long as the weather is good we are pumping 1 10 airplanes through that airport an hour 
but below Cat I minimums the throughput rate drops to 25 airplanes an hour (75% 
capacity reduction). Throughput is a problem when the weather goes down. If we had 
something that enables us to operate in IFR like we do in VFR and keep the throughput 
up, this is a cash benefit for the airlines. How does that fit in what we are doing here? 
He shows a chart on the results of NLR study that was done earlier around 1988. NLR 
study said that: 1) 75% of aircraft involved in CFIT accidents were not equipped with 
GPS, 2) 70% occurred during the approach and descent phase, 3) 20% occurred enroute, 
4) 60% of the approach phase accidents are to non-precision approaches (no vertical 
guidance), 5) 24% of these non-precision approaches were VOR/DMEs, 6) 90 percent of 
the accidents occurred within 15 miles of the airport and 7) 40% did not involve 
significant terrain. If you do not address the approach and landing scenario, you are not 
addressing the CFIT problem. If you do address the landing phase and can operate at 
airports in low visibility weather. Then there is an argument for the financial department. 
If NASA address this problem on the issue of the CFIT arguments then maybe the 
financial department can see this to increase throughput, etc. Give a way for a good 
business case to sell to their management. Not NASA’s responsibility for airlines to 
make money - but I need something new in technology to sell to them. What sells? We 
need to get to Cat II/III approaches at every airport. Curved emerging approaches - we 
would like to do those by allowing us to modify the TERP procedures (Terminal 
Instrument Approach Procedures). TERPs draw trapezoids to prevent airplanes from 
flying into objects on the ground. Takes error in navigation signal to determine size of 
trapezoids. Terrain database might enable us to reduce the TERPs criteria so that we can 
increase our capacity. May need some fusion technology later down the road. Need to 
look at the landing scenario with a good technology focus within 15 miles of the airport. 
Keep the cost low. I have a concern that if the display is there all the time the pilots will 
look at display all the time and not look outside the window - too much information 
overload. And possibly integrate with other sensors. 
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Paul Leckman, Boeing : We at Boeing have pointed out several times the starting point 
system like this is requirements and the people that are using it is the airlines. We need to 
know what they want before we even start out. When we know this then we can start out 
at the right place. ESAS - That program was at a dead-end because of the financial 
justification as he was saying. How HUD’s got on the airplanes basically was because 
they had to be justified by the airlines on an economic basis. Each airline is a little bit 
different. They know best what their financial advantages are for various types of 
equipment. They can weigh if that technology is worth it and when they do decide what 
they want then the requirements are laid down and then we shoot at those. This panel 
was aimed at sensors and CFIT. So, I tried to zero in on that first and I think of how 
sensors might be used in CFIT. I think of the existing enhanced ground prox and 
database as Don Bateman said was perhaps in some cases suspect as well as he knows 
this area where he doesn’t have good terrain data and what he has may not be exactly 
right. I think sensors and a good enhanced ground prox system checks the radio 
altimeters and what they should be reading knowing your position and the height of the 
terrain, and flag captures the areas where they disagree into any significant amount. In 
the future, I think if radar can be used to flag areas where there are disparities and terrain 
databases where the radar indicates that the database may not be correct. That needs to be 
flagged and logged so that those discrepancies can be resolved. I think those are two 
ways that sensors can play role in CFIT. As time passes our database integrity gets 
improved. When you talk about approaches and sensors, I think it is good to have two 
dissimilar navigation solutions because if you lose one you still have the ability to 
navigate by another independent means. Those things like enhanced vision is really only 
up to the airline to figure out whether this is economically- viable or not. There is some 
merit to having an airline in control of its own destiny in terms of approaches if they are 
to be as autonomous as possible. I think there is some financial benefit to be gained 
there. Like Mike was saying when we get the numbers down (category minimums) and 
reduce the uncertainty as to the obstacles and terrain heights in an area around the airport 
on the approach. You can survey the area quite nicely with a laser system, which has 
good accuracy. Or at least in the area where the approaches are being made. Having 
flown several planes with synthetic vision myself, I feel that we have to be careful giving 
the pilot displays that are in any way ambiguous and perhaps difficult to interrupt because 
of the stress of low approaches and the small amount of time you have to analyze what 
you are looking at. 

Richard Burne. Allied Signal: Response to some of the comments that were made in 

regards to the database and the enhanced ground prox warning system. 

Don Bateman has the expertise of what is in the enhanced ground prox database and 
what's not in the database. I’m addressing what is not in the database and it is a big 
concern to me. Obviously, you have multiple sources of error when you are dealing with 
database and onboard sensors. Some of the c onc erns raised from my customers both 
from a cost as well as an implementation certification issue. We have taken an approach 
of using the onboard systems. Enhanced ground prox will be onboard but there is already 
a weather radar system onboard. What we have done is taken that weather radar and 
correlate it to the database. [He shows charts on radar image of the terrain and correlated 
database] We intend to move into this direction to provide the validation of the database. 
We think this will provide us with enhanced safety margins by the database where it has 
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holes and not being valid. The database will be correct for the pilot. We will have this in 
the background and not be seen by the pilot. A sensor combined with a database is 
almost a necessity especially if the database is going to be used as a navigation aid. This 
concerns us to have the database for a navigation aid. As far as providing alert or a 
warning to the pilot, and not to be used as a navigation aid, the enhanced ground prox 
warning system does that for us today. 

Merit Shoucri, TRW : TRW is involved in developing passive millimeter wave as a 
potential EVS sensor. Comments will be generic to sensors and more specific to the 
objective of the workshop that NASA is soliciting industry feedback. I prepared three 
charts. The user community is usually illiterate to sensors or partially illiterate as far as 
sensors is concerned. The user is us, anybody involved in EVS, FAA, and those that 
have different understanding depending on their degree of involvement with sensors of 
what it can do and what it can’t do. Very little understanding on what sensors do. You 
might disagree but just listen to me. Whether the sensors is coming from real-time or a 
database, still the data always comes from a sensor, so this is always back to a sensor 
issue. I see a great need to understand sensors. While airlines are concerned with 
economics, airframers addressing backlogs and trying to push aircraft out of the assembly 
line, and with an R & D at a minimum with industry, the person working the database is 
not necessarily working the EVS sensor or the company working EVS sensor is not 
working the database or the other sensor. There has to be an enlightened body 
somewhere in the US that is working the R&D part as opposed to product. I propose that 
NASA should take credit for a great deal of this function. If we set goals, then what is 
the requirements for it (to develop SV technology)?. I have not seen a set of 
requirements and the reason for that concern we jump to one approach to another. I see 
that a thrust for SVS should clearly look at various architectures depending on rotorcraft, 
general aviation, business, or transport. There are a lot of architectures that can be 
implemented there. So that if it is a sensor or a database or a combination of both we 
need to come to have some requirements. To solve CFIT and visibility induced errors, 
we can take a terrain database approach which is a monocular view. Or we can take a 2- 
dimensional view by using sensors solution with database solution. Or we can take a 3- 
dimensional solution (database, sensor, system requirements) by looking at issues of 
human factors, of integrity, reliability, redundancy. Before we go too far in databases, 
make sure that your 9 digit or 5 digit is doable. Sensors is where the thrust needs to focus 
on. NASA needs to be more ambitious than just looking at the terrain database. Many 
architectures, technology trades and evaluation, concepts and human factors that should 
be addressed in Synthetic Vision NRA. 

Mike Norman. Boeing: Lesson here that should be learned is when you talk about a 
new system or more information in the cockpit for the crew I think you should be more 
suspect before putting that in. This is not saying you can’t put it in but you better do your 
homework carefully before you put it in. You cannot ignore infra-structures costs, 
certification costs and return of investment for the ultimate customer. We are not in the 
safety business. Safety is an adjunct to our business. The safest thing to do is not to fly. 
While we build and fly safe airplanes, the main motive of Boeing and the motive of 
United Airlines is make the money for our shareholders. You cannot ignore that when 
you are talking systems that you have to market and sell on a widespread basis. I think 
we need to decide what we need to do with this SV system. In some ways it is 
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unfortunate that we title ourselves around a system and not a process or a function. We 
ignore that function and go straight to the system. I don’t feel that it takes years to do 
this. We just need to sit down and decide what we want to do with it. I suggest at 
candidates to look at is terrain awareness as distinguished from terrain clearance 
enhancement. I feel they are two separate missions. Autonomous manual control in Cat 
II or III in degraded weather conditions is also a candidate. After deciding this we need 
specifics as to what mission have to do and we need metrics to decide if we have 
achieved those missions. Then we are ready to catalog the technologies that we have 
been hearing and decide what might be appropriate for the task and what advantages are 
more pertinent. Also look at some of the disadvantages. Augment that safety 
enhancements can be good business but make sure you do not ignore business when you 
talk about safety enhancements. 

Panel : What constitutes a successful team? Industry teams to invite NASA to participate 
because you could not do it alone. Key components of a successful team is the users and 
system engineer. To get requirement straight, we need to understand the reliability 
requirements, integrity requirements in turn to response to the users need. Technologist 
is key component of the team and manufacturers are also important part of the team and 
so is project management. Where does the project management come from in these 
teams? Is the industry looking at NASA to provide that management or is NASA looking 
at industry to provide that management? I feel that there is a word missing out of project 
management that maybe it is leadership and where is that leadership going to come from? 
I feel for a team to be successful that it needs strong leadership, and a very strong 
program management. I feel that if we cannot answer these questions that we have not 
accomplished our purpose. 

Tom Campbell : As far as program management what would industry like to see happen? 
[no response given.] 

Carrie Walker : The process is we are going to put out a draft NRA. You will have the 
opportunity to respond to that draft and say we feel we have something to offer that we 
can not propose with these words in the NRA. So we are asking industry to help us with 
our definition and requirements of the program. We have expanded our definition of the 
NRA that we have expected to put out through the education process that these couple of 
workshops have given us. In regards to the project management, Mike Lewis outlined the 
first day the organization of the Safety Office and their elements. Safety Office is the 
integrator of those elements. We expect for the industry teams that are awarded to 
manage their projects as they successfully manage all their projects. And to look to the 
Safety Office for the overall integration of the elements that need to be communicated 
and integrated. 

Comment : Would this be the job of the Safety Office taking it into the marketplace, 
certifying and implementing and supporting it? 

Carrie Walker: No. 
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Mike Lewis : We have some funds-not a whole lot of money- but there is a lot of good 
things going on here in technology and applications. We are putting some money into 
this program. Long term R&D in a healthy kind of way. We are not going to make it for 
both the safety program goal and for the potential as you see in this room and the outside 
of this room if this NASA program is 80-90-100% of the work that’s going on out there 
in SV technology. NASA's role will be a catalyst and we will try to do the right 
governmental things from a NASA perspective. There will be good ideas that NASA will 
not be able to fund. If people think their ideas are good, they will work to proceed 
forward with their ideas anyway. NASA will work with the FAA in setting up 
rulemaking or certification criteria or system performance criteria which will apply to that 
that work independently done as well as the work supported in the NRA. NASA has 
resources that try to bring together an integrated product for evaluation, demonstration, 
test in our 757 aircraft, and on simulations. No way is NASA going to pay 
implementation into the fleet or systems integration of a certified product into existing 
airplanes and so forth. This is a non-NASA role. This part of the program (SV) has great 
potential to pay for itself. Forget the safety benefit - can pay for itself on how planes can 
operate and fly. I hope that you guys are competing against each other to provide that 
capability because it is lucrative. I hope that we can see that this might happen before it 
would. 

Panel : A successful team has got to embrace the objectives upfront that is to reduce the 
accident rate by a finite amount to be able to have an established metric and a successful 
management team will allow us to get there and measure the result. These are all the 
things that Mike Lewis mentioned that NASA is not responsible for and that industry 
must be responsible for. What is the scope of a successful team and proposal? 

Mike Lewis : There are 3 metrics - 1) Technology Readiness Level that NASA is 

involved with and is often the major participant in. Other people do their own R&D and 
do technology readiness on their own. There is also an 2) Implementation Readiness 
Level that is a parallel activity. NASA’s role is directly involved in the Technology 
Readiness Level and in supporting the FAA in the Implementation Readiness Level. 
Implementation readiness level is mostly a FAA job plus NASA plus industry. Industry’s 
role is to look at cost benefits of system, buy it, apply it, and implement it into the fleet. 
Only when 100% of the fleet is equipped will you realize the safety benefit of a 
particular product or technology. NASA will think about the whole process and pull it all 
the way through and establish a safety program portfolio. This arena is fertile enough to 
have multiple groups team together to do it better, cheaper, and faster. 

Vic Norris : We in industry think NASA should consider not only the database 

technology, Synthetic Vision, but bring that problem all the way in (initial approach to 
landing) and blend with sensors. NASA needs to consider total systems aspect. 

Ron Bolton : Approach phase of flight is where we need to concentrate. We are 

changing procedures at the rate of 1,500 procedures every 56 day instrument cycle. We 
really need to make plans soon. I think research effort is necessary - needs tighter 
leadership role. We can solve the research effort with the database in terms of terrain and 
obstacles. The technology is out there with laser technology devices and digital image 
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cameras to get the terrain in the last 5-15 miles of the airport. Don’t look at the past and 
not the future. We are changing procedures very rapidly. We are changing procedures to 
get planes to land out there in poor weather conditions. We need to step up pace with 
sensor technology and database technology. Pilots are flying different approaches at a 
record rate and we need to help them. 

Mike Frank. United Airlines: Where would I put my money? I’d address low 

visibility approach phase to give the pilot guidance in that environment. I would also put 
my money into wake vortices detection, microburst detection, wind shear detection, and 
clear air turbulence detection. 

.Tim Daum. Boeing : In order to supplement a detailed database with sensor data what are 
the computing requirements, update rates, and cost associated with observing with 
integrating and displaying the diffused data? 

Richard Burne: I cannot directly answer the question but I can give you an estimate. I 
believe we are looking at the combination of the radar with the terrain database. It 
requires, for one image, 6,000 cpu cycles or flops processes to be done. This is a rough 
estimate that is done in a laboratory environment and not on the aircraft. 

Russ Parrish : Is image fusion near an operational readiness level yet? If not, when? 
Sensor images contain artifacts that fusion must remove before display to pilot. 

Peter Smovsek : Main issue is to review the main requirements for the task if you want 
to find out how to detect features in the landing area. It depends if you have a fused radar 
image with a FLIR image or FLIR image with a visible camera image. The main issue is 
to determine the requirements for the task and if you want to detect features in the landing 
area. Some sensors like some visible camera sensors are more mature than radar because 
there are less artifacts with the optical transformation. 

Ron Bolton : If you were going to stick you neck out what would you say about 

operational readiness? 

Panel : Concept phase right now or at full-scale, 

Russ Parrish : We have heard during this workshop about the Boeing ESAS program. 
Peter presented the Honeywell fusion product, and we have heard about the Ames fusion 
work. The ESAS output as I understand it is that they did not show an image from a 
sensor to the pilot. They drew the runway outline on the HUD. They never presented a 
raster sensor image. The Honeywell product, as I understood Peter's explanation, took 
multiple sensors and fused it but never showed the image to the pilot. They extracted 
information and then drew something on the HUD. Ames fusion effort was to base most 
of the fusion information on the visible spectrum image so that you would remove the 
artifacts from things like the millimeter wave reflection that we saw in one of the slides. 
We have know about image fusion work that has been going on for years but when is it 
going to be ready? I want to be able to show the pilot something that does not have an 
artifact in it if I am going to use a sensor image. A database does not have artifacts in it 
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and it may be missing things and may not be in the right place and we know how to work 
at that. I just want to know where we are wit h alg orithms. I am concerned with real-time 
but are the algorithms there to remove artifacts from these imaging sensors and give the 
pilot something that he does not have to be trained to recognize. 

Peter Smovsek : For that specific area, they are not . More research needs to be done. 

Richard Bume : Although it is a database and a radar image - it is two images that I 
understand that the pilot sees right now in Alaska airlines. As he is flying down he takes 
the image from both and does the integration in his mind. I believe before the end of the 
year, we will attempt to show that we can do that automatically. The image from the 
radar that the pilot is looking at, along with the terrain data map. That is not addressing 
two sensor images, unless you believe that the data map is a sensor image. 

Russ Parrish : Maybe, Merit pointed out that the database comes from a sensor. 

Tom Campbell : A lot of work will be done in the near future in regard to sensor fusion 
as well in some of the flight test that will be planned. 1 1 3 ; • 

■Tack Barry. Airforce Research Lab : Do we need to include the take-off and departure 
phase? !t vt ;• 

Mike Frank : Safety consideration - A restriction that we do have is that in a departure 
phase TERPs criteria is based on flying heading to avoid obstacles and it is pretty large - 
pretty gross phase. If we had better terrain data and more precise navigation, then we 
could operate at lower minimums then we do now. We need to include the whole airport. 

Kirk Lehneis, 88th Weather Squadron. Air Force Research Lab : Please discuss the 
type of weather information and concept of operations for how you need to integrate 
weather and weather advisory information into a synthetic vision display - possibly 
information including updated turbulence, icing, windshear, lightening, thunderstorms, 
and electric static discharge potential regions. The issue is observed and forecast 
databases do not fully exist to support these parameters. These databases will need to be 
developed by NOAA and DOD in correct format to uplink to aircraft. Can anyone 
comment on the type of weather information and the concept of operations that need to be 
included? 

Merit Shoucri : Just a comment I don’t have the answer. Sensors play a major role both 
in the synthetic/enhanced vision sense and in the weather thrusts (AWIN). As soon as 
these two thrusts get synchronized (as you have alluded to) and be integrated into the 
synthetic vision on how to put in the weather effect. 

Phil Brooks : We might be in a win-win situation. Everyone has a stake in this 

personally and in a policy sense. 

Frank Muller-Nalbach : Airlines don’t develop technology. This technology has the 
possibility of increasing operation from gate to gate. It is important that it [the 
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technology] is developed and put on the market. Then the Airlines can choose to buy it 
or not 

Milt Holt, NASA : We have heard several obstacles for integrating of sensors with 

databases, artifacts, and sensor images. A comment about the situation in Bosnia where 
the sensor did not work because it did not have the range that was necessary. One 
obstacle is the cost of these sensors. Do we know the requirements are for detecting an 
obstacle that would be hazard for an aircraft? Can these sensors either see the obstacles 
in that range or can they be made to see those obstacles at that range? Another question 
is cost. Do any of these sensors have technologies or design criteria that keep them from 
being cost effective if in fact there was enough customer database out there to utilize 
these sensors? 

Richard Burne : Some of the obstacles we are looking at are radio towers. We do have 
some specifics on them as to what criteria for detection and using a radar system. We are 
addressing these issues currently to add those obstacles to the terrain database to detect 
them. If we cannot put them in the terrain database, we still have means to detect them. 
We are designing those requirements. As far as a cost-effective sensor - I think our 
approach is to use the existing sensor (weather radar) that is there in most regional 
transport aircraft. Pull out more information from that radar to use in multiple modes so 
there won’t be much more cost in adding the sensor to the platform. The cost is really in 
the algorithms of the software and is not an expensive item. There is certification issues 
but we will be addressing those as well. 

Ron Bolton : Comment on Databases. One of the SAE groups is saying that Part 91 
operators need data for engine-out type operations and instructions to their pilots. They 
spend immense amounts of money every time things are changed around airports or some 
new obstacles are added to make sure they meet these requirements. One of the benefits 
of having a good database around an airport (and not just on the approach part but the 
departure and other areas) would be a fallout to help people on their engine-out and other 
procedures on takeoff. If you look at a departure chart, you wonder why pilots feel so 
confident as they round the comers. They don’t have any data and it would be nice if they 
had some data to look at. 
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Synthetic Vision 
Workshop 2 


Welcome! 


January 27 - 29, 1998 


Carrie K. Walker 

Manager, Error-Proof Flight Deck & Aircraft Systems Program 
Civil Transportation Office 

©ASTT Airframe Systems Program Office 

irframe Systems Program 


Workshop 1 
December 11, 1997 

Objectives: 

• Introduce the Synthetic Vision Element 

• Receive Initial Feedback 

• Encourage Involvement 

• Discuss the Procurement Process 

• Establish Panel Sessions for Workshop 2 


Product: 

• Outline of Workshop 2 Panel Sessions 


~ASTT 

irtrame Systems Program 
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Synthetic Vision Workshop 2: 

Next Steps 

You: 

• Start Scheming 

• Start Teaming 

• Ask Questions 

• Watch the Web Site 

http://www.hq.nasa.gov/office/aero/oastthp/programs/avsaf/avsafpro.htm 

NASA: 

• Draft NRA 

• Submit Draft for Feedback 

• Assemble Proposal Evaluation Team 


_ • Finalize NRA 

^ASTT 

irframe Systems Program 


Synthetic Vision Workshop 2: 

Next Steps 

Schedule: 

• Draft NRA: Mid Summer 

• Final NRA: Late Summer 

• Awards: January 1999 

Questions: 

• Technical: Parrish & Foernsler 

• Programmatic: Walker 

• Specific Business/Partnering/alliance: Durham 


u-ASTT 

trframe Systems Program 
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Aviation Safety Synthetic Vision 
Information Contacts 



Aviation Safety Program Web Site: 

http://www.hq.nasa.gov/office/aero/oastthp/programs/avsaf/avsafpro.htm 

Contacts: 

• Technical: Russ Parrish 

- R.V.PARRISH@LaRC.NASA.GOV, 757 864-6649 

• Technical: Lynda Foernsler 

- L.J.FOERNSLER@LaRC.NASA.GOV, 757 864-8146 

• Programmatic: Carrie Walker 

- C.K.WALKER@LaRC.NASA.GOV, 757 864-6031 

• Specific Business/Partnering/alliance: Mike Durham 

- M.H.DURHAM@LaRC.NASA.GOV, 757-864-9100 

©ASH 

irframe Systems Program 
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Aviation Safety Program 


Woofetoi?) ‘u’w® 


$4®, HiD® 


Lynda J. Foernsler 
NASA Langley Research Center 


Workshop Purpose 


Provide a forum for interested parties: 

• to discuss what areas they think should be included 
within the Synthetic Vision (SV) element to reduce 
the fatal aircraft accident rate. 


• to give individual presentations on state of the art 
technologies within their organization. 





Largest contributor to aircraft accident 
fatality rate is Controlled Flight Into 
Terrain (CFIT) accidents. 

Approximately 30% of transport 
accidents are attributed to CFIT 
accidents. 

(ref: 1995 Boeing report “Statistical Summary of Commercial Jet Aircraft Accidents - 
Worldwide Operations 1959 - 1995”) 

Even greater percentage of general 

aviation (GA) accidents 

are attributed to CFIT accidents. 


Since 1958, 8300 people have died due 
to CFIT accidents aboard transport 
aircraft. 

Introduction of GPWS in the 70’s 
significantly reduced the number of 
CFIT accidents aboard transport 
aircraft. 

More still needs to be done!! 
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Worldwide Airline Fatalities (1991-1995) 


Over this 5-year period, 3028 fatalities in 59 aircraft 
accidents. 


32% (971) of these fatalities were 
classified as CFIT accidents. 

29% (17) of these accidents were CFIT 
accidents. 


Data obtained from 1995 Boeing report 

“Statistical Summary of Commercial Jet Aircraft Accidents - Worldwide Operation 1959-1995" 


Worldwide Airline Fatalities 

Md byTyp* of AccMsrf-IWMiW 
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Chart obtained from ISM Roohif report 

"Statistical Summary of Commercial Jot Aircraft Accidents • Worldwide Operations 1S8S-1S9S” 
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AOPA Air Safety Foundation 
1996 Nall Report 


The primary cause of fatal accidents in 
general aviation (GA) aircraft was due to 
weather. 

In fact, 69 percent (74 accidents) of all 
weather-related accidents involved fatalities. 

Weather-related accidents usually involved 
controlled flight into terrain or other objects 
or uncontrolled flight because of 
spatial disorientation. 


Current CFIT Prevention Methods 

Installation of Ground Proximity Warning 
System (GPWS) aboard aircraft. 

FSF had a 1992 goal of reducing CFIT accident 
rates by 50 percent by 1997. 

- Improved pilot awareness and situational 
awareness through: 

• Pilot and Controller CFIT training. 

• CFIT checklist for pilots - tool for evaluating 
CFIT risk. 

Installation of Enhanced GPWS with uses airplane 
position, airplane altitude, and worldwide terrain 
and runway databases to predict potential 
conflicts between airplane flight path and terrain. 
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Why are we interested in 
Synthetic/Enhanced Vision Display 
Technologies? 


The majority of CFIT accidents (transport aircraft) and 
Loss Of Control accidents (GA aircraft) can be 
considered to be visibility-induced crew error, where 
terrain visibility would have been a substantial 
mitigating factor. 


Goal of SV element is to : 


Eliminate visibility-induced errors for all aircraft through 
the cost-effective use of synthetic/enhanced vision 
displays, worldwide terrain data bases, and GPS 
navigation. 

Objectives of SV element are to : 

1 . Eliminate CFIT during all phases of flight for Part 121 
Operations. 

2. Provide affordable CFIT avoidance and Loss of Control 
avoidance for GA (Part 135, Part 91 ops) 

3. Provide GPS precision approach/landing guidance for 
transports and business jets. 
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Synthetic/Enhanced Vision Display Systems 

• Regardless of the outside weather conditions, these 
display systems allow for presentation of three- 
dimensional. perspective scenes with necessary and 
sufficient information and realism to be equivalent to 
bright, clear, sunny day. 

• VFR-like display capability provides pilot with increased 
spatial awareness (e.g., terrain, attitude, and traffic). 

• Symbolic information can be overlaid on these 3-d 


perspective scenes to enhance situational awareness 
and tactical guidance capability (e.g., presentation of 
an artificial horizon, heading, attitude indications, and 
pitch and/or velocity vector references). 


Synthetic Vision vs. Enhanced 
Vision Display Concepts 

Synthetic Vision systems are based on precise positioning 
information (GPS) within an onboard terrain database, and 
possibly traffic information from surveillance sources (e.g., 
TCAS, ADS-B, air-to-air modes of weather radar, etc.). The 
view of the outside world is provided by a computer-drawn 
image that may include information derived from a weather 
penetrating sensor. 

Enhanced Vision systems are based on display 
presentations of onboard weather-penetrating sensor data 
combined with some synthetic vision elements. The view of 
the outside world is provided through a transparent display (a 
Heads-Up Display) of relevant flight information, which 
includes an image from a weather-penetrating imaging 
sensor. 
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Synthetic Vision Element 


Goal: 


Eliminate visibility-induced errors for all aircraft through the cost- 
effective use of synthetic/enhanced vision displays, worldwide terrain 
data bases, and GPS navigation. 


Objectives: 


Low-End Thrust Provide an affordable synthetic vision display system 
for the low-end general aviation aircraft operating in Visual Meteorological 
Conditions (VMC) to transit back to VMC in the event of the unplanned, 
inadvertent encounter of Instrument Meteorological Conditions, including 
low ceiling and low visibility weather conditions. SV display system 
provides pilot with attitude and terrain awareness. 

Hiah-End Thrust Realize/demonstrate the potential safety benefits 
(elimination of CFIT accidents, GPS precision approach/landing guidance) 
of synthetic/enhanced vision display systems for both high-end general 
aviation aircraft (business jet) and commercial transports. SV display 
system enhances a pilot’s situational awareness and tactical flight path 
management in low visibility weather conditions. 


Synthetic Vision Element 


)roach: 


Through system studies, piloted simulations, systems technology 
assessments, and integrated concept assessment flight tests: 

• Evaluate cockpit systems technology suitable for integration into 
synthetic/enhanced vision display systems 

• Iteratively develop and evaluate candidate synthetic vision display 
concepts and systems for terrain and attitude awareness in low-end 
general aviation aircraft 

• Iteratively develop and evaluate candidate synthetic/enhanced vision 
display concepts and systems for situational awareness (e.g., terrain, 
traffic, and attitude) in high-end general aviation and commercial 
transport aircraft 
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Synthetic Vision 

approach: (cont.) 

Metrics and Exit/Success Criteria 

• Simulation Evaluations / Comparisons 

• Flight Tests 

• Commercial Package Development 

Anticipated Partner Participation 

• Low-End Thrust 

• AGATE Consortium 

• GA Avionics & Manufacturers Industry 

• FAA 

• Universities 

• High-End Thrust 

• User Community (ALPA, APA) 

• Avionics & Manufacturers Industry 

• FAA 

• Universities 


SV Funding Profile 


4500 
4000 
3500 
- 3000 
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US 2000 
** 1500 
1000 
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FY98 FY99 FY00 FY01 FY02 


FY 98 FY 99 FY 00 FY 01 FY 02 
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Outline 


• Partnering Philosophy 

• Benefits of Collaborative R&D 

• What is a NRA? 

• Desired Proposal Attributes 


?ASTT 


Partnering Philosophy 

• NASA funding to serve as catalyst 

- Attack hurdles to development/certification/implementation 

• NASA will not pay for all of anything 

- Leverage resources, cost sharing 

• Stretch industry investment time scales 

- Near-term focused strategies limit ROI in changing NAS 
(avoid Band-Aids, search for cures) 

- Gov’t role in near-term less clear 

• Increase risk tolerance through partnerships 

- Systems implementation provide more rapid ROI 

- Reduce chance of taking wrong safety technology “fork in the 
road” to NAS modernization. 

#ASTT 
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PORTFOLIO STRETCH AND BALANCE 


Minimum 

acceptable 

payoff 


^7 


Alliance ROI time limit ' 

Company — . 

ROI time limit \|f 


wz> 


Maximum acceptable risk 
for gov’t-industry 
collaboration 

Maximum acceptable risk 
for company investments 

Minimum acceptable risk 


Payoff 


Joint R&D government-industry ventures stretch 
portfolios in risk and time for higher payoffs 


What is a NRA? Why? 

NRA = NASA Research Announcement 

- Requests research proposals, conceived by the offerors, in broad 
technical areas which are difficult to define 

- Impossible to draft specification/RFP in sufficient detail 

- Multiplicity of possible approaches 

- To encourage new and creative approaches 

Can not use NRA to: 

- Solicit proposals for a specific system or hardware procurement 

- In place of RFP when requirement is narrowly defined 

Multiple awards of grants, contracts, cooperative 
agreements, or other agreements can result from NRA 

- NASA will determine appropriate instrument 

- Contracts are subject to FAR 

- Grants/Coop Agreements subject to NASA Grant and Cooperative 
Agreement Handbook (NPG 5800.1) 


ASTT 
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GOV’T BUSINESS TOOLS 



GRANTS/COOPERATIVE AGREEMENTS 
VS. CONTRACTS 

Grants 

- To carry out public goal of support or stimulation 

- Substantial involvement is NOT expected by gov’t 

- Gov’t carries ail risks 

Cooperative Agreements (Vested Partnerships) 

- Gov’t/Industry co-leadership role 

- 50/50 Cost-shared (Shared risk) 

- Fixed-funding (Gov’t share) 

- Gov’t participates substantially in effort 

- “alliances” encouraged 

- Intellectual property rights negotiable 

- GAAP, commercial accounting standards 

- Streamlined “procurement” process 


^ASTT 
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Desired Synthetic Vision 
Proposal Attributes 

• Proper technical breadth/focus & direction to contribute lOx goal 

- Address display problems, implementation hurdles, system integration 

- Technically aggressive (no nibbling at the edges) 

- Goal-oriented, data-driven, metrics-monitored 

• Partnerships representing aviation community 

- Coordinates issues from manufacturers, operators, regulators, users, etc. 

- Leverages activities of other gov’t agencies, alliances, and programs 
— Operationally realistic & implementable 

• Considers complete path from technology development to test to 
certification to implementation 

- Funded research may only address one phase but all relevant issues 
included in research plans 

- Identifies transition path (retrofitable, interoperable, upgradeable, NAS 
modernization) 

• Efficiently managed team through one agreement 

- Joint partnerships/alliances wherever possible 

- One business partner (prime or alliance arrangement) 

©ash 





Advanced Navigation Instruments 

Presented by Dr. Eric Theunissen 

Laboratory for Telecommunication and Traffic Control Systems 
Faculty of Information Technology and Systems 
Delft University of Technology 
P.O.Box 5031 

2600 GA Delft, The Netherlands 

tel: +31 15 278 1792 
fax: +31 15 278 1774 
e.theunissen@et.tudelft.nl 


handouts 
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Overview 


Advanced Navigation 
Instruments 

Dr. Eric Theunissen 

Faculty of Information Technology and Systems 
Delft University of Technology 

URAMUU IUmmS Into Itorlf Saw htlrUllwili 


• The potential to increase safety 

• The URANIUM network 

• DELPH1NS I (1990-1996) research 

• DELPHINS II (1996-2000) research 

• DELPHINS display system 

• Conclusions 

• Video 

URAMUM Unt<«J R«»arch into A4**nc*4 N»»ij»hi>n ln*trUM«n(« 


The potential to increase safety 


The URANIUM network 


Positioning Communication n a t a H ase 
system system 4 


Navigation, 
guidance, and 
control 
functionality 


Displays 

Co*np*cl. low<oti, 


Controls 


URAMUU Un.l*d n«H«th into Arfvnc«4 N»-r1 j»Bon InitrUMaoti 


Current members: 

- Delft University of Technology 

• Faculty of Information Technology and Systems 

- Munich University of Technology 

• Institute of Flight Mechanics and Right Control 

- Ohio University 

• Avionics Engineering Center 


URANIUM Untltd FU..«fch into Advanced N«..,.hon ln«lrUV»nti 


The URANIUM network 


DELPHINS I (1990-1996) 


Accurate 3-D position determination OU & TUO 

(D)GPS. 
integrated 
positioning 

Digital datalinks OU 4 TUD 

C-band. 

VHF 


High performance computer graphics TUM & TUD 
Guidance symbology, 
terrain depiction, traffic 
depiction 


URAMUU Uf»M liHWh into A#»w«»4 N*ri|»l*n ln«hUM«nl» 


• To identify, structure, and place into context 

the technical, control-theoretical, perceptual, 
and cognitive aspects involved in the design 
process of an MM I for 4-D navigation based 
on the presentation of spatially integrated 
data 


URANftJU U*t«4 fiMtnrth into A4vmc><4 tfevijtlton IntltUltonH 
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DELPHINS I, 1992 


DELPHINS I, 1993 


* Study into the 
representational 
aspects 


URAMUM United Raeearth Into Advanced Kavigatian InalrUUenta 



• Study into the effects of error-gain and prediction 



ep»r pen fda y eln / 

URAMUU Unrted Rataarth into Advanced Navigation InatriJManu 


DELPHINS I, 1994 


DELPHINS I, 1995 


• Study into error- 
neglecting control 

• In-flight testing 



URANUM 


United Reaeavth Into Advwvcad Navigation InatrUMenla 



DELPHINS I overview 

• Integrated Design of a 
Man-Machine Interface 
for 4-D Navigation 


DELPHINS II (1996-2000) 

• Towards the integration of perspective 
displays into the flightdeck 

• Focus on a wider variety of applications 

• Address integration issues 

• Sponsored by the Dutch Technology 
Foundation STW 



URAMUM United Reeeerch Inte Advanced Navigate" inalrUManl* 


United Research Advanaad Navtg alien InatrUMenla 
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DELPHINS II (1997) 


DELPHINS II (1998) 


• Study into surface 
movement guidance 
display formats 
(frame of reference, 
prediction) 

• Cooperation with the 
AEC for integration 
in test vehicles 



• Pilot-in-the-loop study in cooperation with Munich 
University of Technology 

• Integration and testinq of taxi guidance display in 
AEC SMURF 

• Study into influence of position data latency 

• Development of data-shaper 


URAMUM Unclad RaaaarcH ini* Advanaod Harlfallan InatlManla 


URANIUM UftM Raaaaith into Advancad NavtfaHon InitrUMania 


System development 

• 1990: Display hardware (PC-based) 

• 1991 DELPHINS Display Design System 

■ 1991: Integration in moving-base flight simulator 

• 1994: PC-based experimental in-flight system 

• 1997: New generation display processor 

• 1998: DELPHINS II in-flight target system 


URAMUM Unaiad into Advanced Nevifatton InatrUMant* 


DELPHINS II display system 

• Experimental system for research applications 

• Computer aided design, autocode generation 

• COTS, PC-based 

• All the usual features (anti-aliasing, gouraud 
shading, alpha blending, texture mapping, tri-linear 
mipmapping, subpixel correction) 

• High performance, low cost (<2K$) 

URANIUM United Reaearch Into Advanced Navigation InatrUMenlf 


Conclusions 

* Today, depiction of spatially integrated data is 
easy 

* An approach has been developed which allows 
many of the design decisions to be evaluated in 
the appropriate context 

• An experimental display computer has been 
developed which costs less than 2K$ 

• An evolutionary introduction of 3-D is feasible 

URAMUM United ReaeercK inla Advanced Narration tnitrlManU 
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Fig. 1.2. Overview of the systems involved in the presentation of navigation data. From 
‘Integrated Design of a Man-Machine Interface for 4-D Navigation \ Theunissen, E. 
(1997), ISBN 90-407-1406-1, Delft University Press, Delft, The Netherlands. 
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Traffic — i 
Terrain —\ 


Cross-sections — i 
Interconnections 
Altitude poles • 


Navigation 

forcing 

function 



Flightpath vector 

Predictor 

Indicators 


r Frame of Reference 
Viewing distance 
Fieid-of-view 
I— Tunnel size 
Frame spacing 
2D symbology rules 


Fig. 5.1. Transformation of the forcing function into an image which is stored in video 
ram (VRAM). From ‘Integrated Design of a Man-Machine Interface for 4-D Navigation 
Theunissen, E. (1997), ISBN 90-407-1406-1, Delft University Press, Delft, The 
Netherlands. 65 


















Cross-sections: 

* Rectangle (solid, open, ticks, brackets , 

* U-shape (open, tapered) 

* Diamond 

* Tiles 

Interconnections: 

* present or absent 
Altitude poles: 

* present or absent 
Ground track: 


Wire-frame aircraft 
Terrain grid 


fZ 

I Static synthetic 
j. data 



■ Predictor: 

* symbol + window 
Flightpath vector: 

* symbol 

Altimeter: ~ 

* tape or dial 
Airspeed indicator: 

* tape or dial 
Heading indicator: 

*iape ] : , . 

Roll indicator? 

* fixed scale with moving bug 


All objects selectable 
through validity flags 

Frame of Reference: 

* egocentric and exocentric 

* inside-out and outside-in 

' attitude and velocity vector alignec 

Viewing distance: selectable 
Field-of-view : selectable 
Tunnel size: selectable 


Fig. 6.26. Overview of the functionality which has been implemented. From 
‘Integrated Design of a Man-Machine Interface for 4-D Navigation Theunissen 

(1997), ISBN 90-407-1406-1, Delft University Press, Delft, The Netherlands 
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URANIUM - United Research into Advanced Navigation InstrUMents 




























URANIUM - United Research into Advanced Navigation InstrUMents 






July 7-10, 1997, Schwarzwald / Freiburg Airport, Germany 






URANIUM - United Research Into Advanced Navigation InstrUMents 






Wide Area DGPS Local Area DGPS 

(Altmuhltal, Schwarzwald) (Braunschweig, Lugano) 



URANIUM - United Research into Advanced Navigation InstrUMents 









T-NASA (Taxi way Navigation and Situation Awareness) 
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Moffett Field, CA 94035-1000 
Voice: (650) 604-3053 / Fax: (650) 604-3729 
dfoyle@mail.arc.nasa.gov 



OVERVIEW / DESIGN PROCESS 



3-D Audio Ground Collision and Warning 







OVERVIEW /DESIGN PROCESS 



Perspective Moving Map Display 
3-D Audio Ground Collision and Warning 







TAP PROGRAM RATIONALE 
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TRAFFIC GROWTH 

Projected 32% increase in air traffic in next 10 yrs 


OVERVIEW / DESIGN PROCESS 



Perspective Moving Map Display 
3-D Audio Ground Collision and Warning 









T3 

C 


3 - 
2 ~ 


■o 

0 

0 

a 

0 

0 


o> 


0 


CO o 
Ui -2 


>>£ 
^ 0 

TJ 3 
0 O 

g >* 
0 £ 
o a> 

0 -E 

1 5 

I? 

£ * 

ii 

£ £ 
- « §> 

0 0 


CO 

o 

CNJ 

0 

mmm 

X 

0 


.2 0 

t I 

o > 


D 5 £ r 
O c 


o 

o 


< ;* = 


ii 


0 £ 

Is 

.£ > 


^ X - 

> ? 2 f 


0 


LL > 

O 7 
<0 ® 


(0 
o ; 


■o ™ 

C 0 
D 


0 c 

5* O 
0 o 


V 

0 *0 

£ ■D 

■}- ® 
0 0 


UJ 

I 5 CO = 


O ■? 

0 5 
TJ 

a) 0 
.E 0 

1 § 
■D O 

: 0 

£ c 

o D) 
0 W 

° | 
0 w 
L. 

O =. 

£ §■ 
® E 

4- 0) 


0 o> 

~ .E 

2 w 
o 3 

TJ o 

® o> 

c 

± o 

3 *- 
£ 0 

£ 0 
0 | 

0 > 
C ^ 

o) S 

0 C 

y 

— E ^ 

LL O = 

QJ (/) O 

D = 


CO 

UJ 

O 

z 

UJ 

O 


■ 

< 

o 


> 

0 

£ 

JU 

3 

O 

o 

U) 

4-» 

0 


0 

5 


O o 

H O 

CL > 

* § 
O ? 

8| 

CC « 

LU » 

I! 

LU 2 
> c 

FS 

o £ 

LU c 

t 2 

lu a 


86 



TAXI IS HEAD-UP, EYES-OUT TASK 

"I like [the] idea of moving map display... should be a secondary display, 
not a primary display, since it requires me to be heads-down." 

"[In Low-Vis.] I see things out the window (lights on... aircraft, RWY markers). 


OVERVIEW /DESIGN PROCESS 



Perspective Moving Map Display 
3-D Audio Ground Collision and Warning 
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Aircraft ID-to-Flight No. Lookup 




OVERVIEW / DESIGN PROCESS 



Perspective Moving Map Display 
3-D Audio Ground Collision and Warning 







INFORMATION REQUIREMENTS 
FOR LOW-VISIBILITY TAXI 
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OVERVIEW / DESIGN PROCESS 



• Perspective Moving Map Display 

• 3-D Audio Ground Collision and Warning 
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Taxi way Navigation And Situation Awareness Syste 
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3-D AUDIO TRAFFIC ALERTS 


Map Research and Design Efforts 



Clearance text / map size 



Map Research and Design Efforts 



ZOOM 5X 3X 2X IX OVR 


Head-up Display (HUD) Symbology 
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McCann, Lynch, Foyle & Johnston, 1993 
Wickens & Long, 1994 


HUD Design Issues/Principles 
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Location text 
information 
Turn signs w/ true 
angle 

Route marker cones 






Synthetic Vision Challenges 
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VDO Luftfahrtgemte Wcrk (".mliH 



Synthetic Vision System VDO 



VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 




pproach VDO 



VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 






4D-Display & ND VDO 
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VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 




4D-Display & ND VPO 




VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 




ND Taxi Mode VDO 
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Digital Grafics Module VDO 
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VDO Luftfahrtcierate Werk GmbH 60439 Frankfurt 


Digital Grafics Module & Data Preprocessing VDO 
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VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 



4D-Display Flight Test Programme 
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ATTAS Flight with 4D-Display \/DO 



VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 
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VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 



ATTAS Flight with 4P-Display VDO 



VDO Luftfahrtgerate Werk GmbH 60439 Frankfurt 
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JFIT Avoidance 
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r Jts: by Ftoyd Adagio v . 

Cambridge.Research- Associates, McLean, VA 
(703) 790-0505 or adagio@cambridge.com 




Overview 
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Cambridge Research Associates 
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^ Cambridge Research Associates 


nd Industry Recognized 
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*- Cambridge Research Associates 



fc* 2 

<D H 

SP <*- 

2 O 


c/3 

a 2 

3 w) 

eS O 

<D CD 
5+H bQ 

C/3 C+-I 

« o 


CD <D 

H-> 

C/3 C 

>> •§ 

C/3 Cd 


cd cd 

.H ■- 
■3 t>o 

cd 

O T3 


I gn 

m X 


Oh £> 
Oh ^ 
^3 C/3 

oo <D 

g § 
£ o 

C/3 O0 


<D 3 
2 i 

jd g 

O Oh 


s 

bO 

to 

e 

o 

O CD 


p e 


• • 


cd 

CD 

« >> 

tf ^ 

8 g> 

v-< cd 


Oh bD 

0 C 

1 ■<— i 

1 = 

2 cd 


T3 3 

2 td 

a n 

£ =3 

o 

p .§ 
< > 


C -p 

o c 

cd 

Cd c/3 

(J * 

0 £ 

1 1 

2 § 

d 2 
2 £ 


03 cd 

O ^ 

P4 


J 

.z*' 

v HCwn^ i 


122 


Online search, browse, & visualization of dispersed geo- 
database 


User Applications 
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• International Media & News Networks - ABC, CBS, NBC, CNN, 
Discovery Channel, plus Far East, Latin and European Networks 

• Public Relations - Air Force Museum, Liberty Science Park 


Concept 
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Cambridge Research Associates 


PowerScene Demo 
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^ Cambridge Research Associates 
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PowerScene Imagery 
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^ Cambridge Research Associates 
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Cambridge Research Associates 
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Demonstration Steps 
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Estimated Timeline 
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NASA Synthetic Vision Workshop 2 



Airline Experience With GPWS 
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It Presently Remains at 0.44 for FAR 129 Operations 






COMMERCIAL JET AIRCRAFT ACCIDENTS 



139 


EGPWS Design Requirements were based on addressing GPWS weaknesses 

while maintaining GPWS safety benefits 





DUCTION IN GPWS UNWANTED ALERTS 

BRITISH AIRWAYS A32# FLEET 
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Enhanced GPWS Warning: 30 seconds (not Installed) 
"Too towl Terrain!" 



TERRAIN CLEARANCE FLOOR 



.<n 




..if 





■.v.rV> 4 ■;/- 

*■ ^ < f “ 


: V‘S'*V$ 
A ; '*#;•> 


*>i •v •.• >• 

•V* •'3 


143 


13 T i I 0 1 | » 

Br$pd!ii^ 



144 









CO 

H 
_j DC 

< *H 


^ < 
O CC 
Z D 

i= < 

<n Q 

x z 

LU < 


c n l. u 

Stii 

a >oq 

f \ O © © 

O jc w 
Z p- cc -D 

— E © © 

Q£ rj Q. © 

< -I CO X 


LU 


CO g 


< 

q: 

d co 

> X 

> LU 
UJ -I 

z < 


w 7 T 

& £ 
og 

z < 

<* 
o: cc 
q: O 

UJ > 

tZ 5 

o a. 
><2 
< o 

_j . 
Q. > 
CO < 

52 



CO 

CO 







e « 

D O 

z (0 

o « 


CO "S 

.2 $ 

Sfr 

>< 
Q) a 

"O -O 
3 © 
-S <D 

5 a 
< » 


^ K 

© ™ 

2 ® c 
o *o 5 

OT I . 

5 ? 3 

o a 


© 53 
m S 

*o °- 

C L. 
3 © 
O © 

£ CD 


>» a> 
© cm 
a 

© o 
o z 

© * 

■o < 

© :r 

£ O 

co 4o 


147 






148 




EGPWS PAYBACK 
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Time Validation 
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CFIT-- A Five Year Report Card 
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Don Bateman AlliedSignal Redmond Wa. 



1992 CFIT Task Force Five Year 

Objectives 
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Risk Geographical Areas of the World 



World Civil Turbine Powered 
CFIT Accidents 
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Regional/Ce#porate/Air Taxi Large Commercial Jet 



1997 Five Year Results 
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CFIT Risk Factor has Dropped From 80 
to 40 


Task Force’s Efforts With The 
Greatest Returns 
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Terrain to Instrument Procedures. 


Task Force’s Disappointments 
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& Procedures To Existing Air Traffic 
Control Equipment 
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Hull Loss Accident Rates 
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1993 to 1997 0.47 per Million departures 

Improvement Over 10 Years of 14% 



CFIT Hull Accident Losses 
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1993 to 1997 0.03 per Million departures 

No Improvement 


The Future 
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The CFIT Risk By Another Factor of 10 
Future Technology Has Great Promise 
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Panel Members 
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foject Pilot, Production Flight Test, Boeing Long Beach 



N on- Attribution 


^3 

cl S 3 
> -Ss 

§ 2 

& Q 

•5 

co 


Cj 

si 

CL 

&o 


CJ 

• p-o 

a 


S3 S 

2 • - 
F S^ 

g .s 

^ Si 

O cl 
fco -Si 

^3 <L 
Si g 

2 •« 
-* £ 

&*§ 

o ^ 

^ -2 
4-^ 

co Q 
<L> -S3 
<L > 

?s ^ 
^ * 
&-S 

c§ .5 


c 

C3 


2 

2 g 

Cxc 

si t3 

§ § 

-S3 5 

o 

a 

.5 

si 
cl 

§■ 

^3 _ 

g £> 

Q *3 

§ 

si -§ 

^3 

2 R 

<^> ^3 

S c 

V <D 


CL 

E--h 

# 

& 


CL 

si 

Q 

S3 


So 

.5 

5 

<l 

3) 

si 

o 

o 


o § 

3 S 

Cl ^ 

§* g 

-si r <$ 

2 O 


15 

o 


si 

cl 

cl 


-S ^ 

4««» 


5^ 

^ <L 


^"2 s 

§ §1 

*r-» si q 

a £ •§ 

‘3f ^3 

S s s 
Q Q £ 

•S ^ ° 

^ 2 -h 

g ^3 cl 
^ ^ -si 

^ Co ^ 

I g 2! 

> g Q 

5^3 

cv ^ o 

S 2 % 

■N ^ ^ 

«* .2 s 

3 3 o 

^ *S .2 

a §.^3 

so ^ .2 
si ,3 

5 S -S 

^ ^3 £» 

O =o -s: 
'♦«-» +*'> _ 
^ si g 

S3 2 *> 

3 S O) 

> g S3 

<3> ^ s: 

^ 33 Cl 

^ ^ S3 

* r rv. 


CJ 
’ *--* 

§ 

'L 


CJ 

CL 3) 

sc <o 
^3 * — * 
S? ^ 
<L 

k. 


-Si 

5^ t3 
-si 

i-<k 


4^ 

a 


o 5 


o 


si 

o 


Co 

o 

&< 


si 

o 

* 

• i^i 

o 

5 Sl 


4-^, 

a 

co 

Co 

co 

CL 


si 

S3 

co" 


^ 2 

’3 ^ 

<^o 2J S 


Co 
CL 


f\? 


px ^ si 

^ ^ a 
^ Si g? 


Pc 

-si 

4^, 


4-^ 

o 

si 


CL 

* 

CL 


L. 

o 

CL 

_ ’ -** 
^3 Si 
CL Q 

cl 


^ -2 
cj ^3 


L. 

L» 

,CL 


2- ^ 
X ^ 
CL -S 


o 

cj 


164 


Workshop participants are requested not to attribute these 
statements and opinions in any other context. 
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Output - minutes/lists to be used in preparation 
of NASA Research Announcement 



Some Personal Thoughts 




P 

# o 

a 

£ 

u 

a 

to 

a 

a 

nd 

a 

2 

o 

£ 

c /5 

OJ 


QJ 


o 

in 


a 

C/5 

O 


0/ 

s 

a 

o 

u 

> 

a 

0) 

a 

4> 


a 

Jm 

a 

'M 

C3 

C/5 


a 

a 

o> 


s* 

a 

C/5 

C /5 

o> 

o 

a> 

a 


a 

C/5 

0) 


C /5 

a 

0/ 

s .2 

^3 13 

S3 

■si 

a a 
a *j3 

O C /5 

•& a 

a 


C /5 

*in 

m 

a 

TJ 

a 

w 

C /5 

c /5 

0> 

Jm 

as 

a 

C /5 

a 


C /5 

S 

0) 

C /5 

C /5 

0> 

2m 

a 


JM 

u 

a 

CJ 

w 

'd 

a 


£ 

a 

a 

2 m 

0 / 

a 

5 

S 3 

0 / 

£ 

o 


g 

2 

ox 


• p—4 

a 

a 

m 


0 ) 

a 

o 

*5 

a> 

C /5 

. 2 * 

a 


OX 

a 

C /5 

Ih 

0 > 

ft 

’ox 


%4 


g 

• 


'd 

* ^ 

a 


a 

Pm 

C /5 

a> 

a 

u 


c /5 

O o 


ox 

c/5 a 

o ! 
£ 6 


OX c /5 

2 o 
£ -a 

C/5 M-> 


16 S 


Don’t allow pilot to become the sole cockpit 
integrator of critical information 


Some Personal Thoughts (Continued) 
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Minutes/Proceedings (NASA) 



Program Challenge 
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Control/Display Unit (Touch Screen Device) for 
Inflight Route Planning and Flight Plan Execution 


In the context of an experimental technology study a demonstrator version of a control/ 
display unit, called Touch Screen Device, was developed at DASA Airbus in Hamburg, which 
permits an inflight (low altitude) route planning and flight plan execution for a future military 
transport aircraft. 


Figure 1 shows the Touch Screen Device as part of a control station for the Tactical Operator 
installed in our engineering flight simulator. 

The Touch Screen Device consists of a colour LCD (Liquid Crystal Display) and a touch- 
sensitive overlay. The display formats consist of a graphical part and a menu column at the 
right edge. There are two basic operational modes: 

- Navigation Mode 

- Planning Mode. 

In the Navigation Mode the display formats are consistent with those of an (AIRBUS) 
Navigation Display. The basic graphical information displayed is: 

- Present Position 

- (Active) Flight Plan. 


Additionally, ranges can be changed, the orientation of the display can be modified 
(ARC, ROSE, PLAN mode), navigational aids (VOR, TACAN, NDB ground stations and airports) 
can be selected, and alternative flight plans can be displayed. 

On the basis of DLMS (Digital Land Mass System) data additional map information can be 
presented as for example: 

• Topography and the vertical flight profile (Figure 2) 

• Perspective view of the terrain and the flight progress (Figure 3) 

• Terrain elevation and obstructions relative to present aircraft height (Figure 4) 

• Military threats or other airspace restriction s (Figu re 5). 

The Planning Mode permits to generate a (low-altitude) flight profile either manually or 
automatically. In the manual mode the horizontal flight route has to be defined, first, for 
instance, by manual-interactive input of waypoints. Then, the vertical profile is calculated 
automatically on the basis of DLMS data taking into account terrain and obstructions as well 
as the performance of the aircraft. 

The trajectory from the present position to a given destination waypoint can also be 
generated completely automatically. 
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Figure 1: Control/Display Unit (Touch Screen Device) 

for Inflight Route Planning and Flight Plan Execution 
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— Daimler-Benz Aerospace 
• Airbus 



Figure 3: Navigation Display Format: 

Perspective View of Terrain and Flight Progress 
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Figure 4: Navigation Display Format: 

Terrain Elevation and Obstructions 
Relative to Present Aircraft Height 
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Figure 5: Navigation Display Format: 

Military Threats of other Airspace Restrictions 
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Tunnel-in-the-Sky 
Display and Sensor V\ 
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NASA Synthetic Vision Workshop 
NASA Langley Research Center 
27 January 1998 





Tunnel Display Project 
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access by all sectors of aviation 
% Most previous work has focused on simulation 

$ Address operational issues through flight testing 



Sensor Issues 
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on-air-carrier aircraft need inexpensive sensors 
Differential GPS for positioning 
Expensive INS or AHRS replaced by GPS 
attitude and automotive I MU 
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Segmented Approaches 
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FTE on Segmented Approaches 
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Curved Approaches 
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East Position [nm] 




Conclusions 
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% Safety and utility can be improved across a wide 
spectrum of aviation 



Stanford’s Approach 



0 

o 

c r 
0 o 

' i — 

a> $ 

Q _ 0 
X ^ 
0 ^ 

£ >» 
O) J5 
= o_ 
_ 0 

i 5 =5 

'o o 

CD «*— 
C 0 

o 3 

0 .i 

> co 
0 

0 0 

* E 

0 0 

C Ql 

0 §- 
O 0 





c 

■O 

■ 

"0 
H— » 
0 


0 

0 

0 

0 

0 


O 


Q 


0 

.0 

i 

O) 


0 


CO 

0 

0 


0 

0 

0 

_Q 

0 

CD 

"O 

0 


O 5= 
C 
-X 

T3 


O 

£'3 

0 ^ 

O 
C CO 


CD 


= 0 
0 CO 

o 

eco 

is 

£q 

0 

0 

0 i 


-S ° 

8 

0.2 'F 

o<-§. 

§■« 2 

O 0 CD 

tUtj 

0 o c 
-C **- 0 
T 0 r- 

.E Eo 
E ■£= 0 

!&•§> 
= 5>S 
.c < c 


189 


♦ Address needs of initial users 

- May not be in passenger operations 
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Q Trimble Navigation for the attitude receivers 

The Federal Aviation Administration for 
sponsoring this work 
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OUTLINE 
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PURPOSE OF BRIEFING 
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ies a functional aircraft into the terrain 


USN/USMC HELO CFITs 

( 1966 - 95 ) 
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Based on Naval Safety Center (NSC) accidents statistics 


HELO CFIT ANALYSIS 

TERRAIN TYPE 
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Based on NSC accidents statistics 


JOINT RECOGNITION OF CFITs 
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NAVY GPWS PROGRAM 

THREE CATEGORIES 
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CRT MISHAPS 
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Based on NSC accidents statistics 
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HOW IT WORKS 
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penetrate a Minimum Recovery Altitude (MRA) 



AIRCRAFT SENSOR INPUTS 
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Weight on Wheels 

Pilot and Co-Pilot RADALT bug setting 
Landing Gear Position 


GPWS REQUIREMENTS 
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GPWS OUTPUTS 
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- platform specific implementation 


CAT Ul CFST ANALYSIS* 

GPWS SAVE PROBABILITY 
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Based on NSC accident statistics 



GPWS CAT III HARDWARE 
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Weight 
7.4 pounds 



EMBEDDED INTEGRATION 
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>3 MIPS performance 
146 Kbytes program memory 
29 Kbytes RAM 


FUTURE INITIATIVES 
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advisories 

- Determine user requirements and best 
technical solution 


NOTIONAL SCHEDULE 




PMA-209 SUPPORT STRUCTURE 
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funded for production 

Contract vehicle and Life-cycle support 
in place for new users 
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The Instrument Approach Procedures Branch (AC&C) charts approaches to approximately 
7,500 runway ends in the United States, Puerto Rico and the Pacific Islands, ii 

The Federal Aviation Administration (FAA) has approximately 16,000 airports in their 


yJh'Ss 4 £6~ S f St iS 


* oji 


a 

<U 

co 

CO 


I— 1 


CO 


a> 

U, 

4 

<D 

O 

o 



J-H 


Plh 


X 


o 

CO 

cd 

Ph 

o 

< 

S-h 

a, 

HH 

x, 

C 

C 

O 

• 4 

ts 

CO 

• 1—4 

o 

<D 

<D 

c 

1-4 

C 

Ph 

B 

c 

CO 

o 

a 

c 

i— t 

<D 

> 

c 

o 

cd 

• ^ 
CO 

X 

• ?-* 
o 

<D 

CO 

ts 

u. 

o 

Cl, 

a> 

& 

> 

cd 

cd 

t 

X 

cd 

CO 

G 

ts 

O 

• *“H 

o 

4-» 

• I-H 

& 
* i-H 

T3 

X 

cd 

cd 

o 

O 

o 

O 

<o 

<o 

r-H 

cT 

d 

• 

X 


CO 

< 

HH 

£ 

<d 

X 

• H 
00 

73 

<D 

e3 

"O 

c 

cd 

o 

x 

a, 

<u 

X 


§ 

Ph 

O 

<D 

cd 

CO 

ts 

o 

& 


cd 

C 

O 

• 

.ts 

T3 

cd 

O 

O 

oo 


o 



260 




ARTSII and ARTSIII 

! ?f 5 i ; : 

Traditional Sites 
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ARTSIIE and ARTSIIIE 
General Terrain Sites 
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STARS MSAW 



264 







n (D 

-a x: 

' *5 tifi 

V |S ••“< 



P. ■mm^&smm 


• x /l :-^ . rt jTJ ■ v; f; V,.< T r;;- -~r x 


C/5 

T3 

c3 

T3 

§ 




GO 

X) 

O 


00 

fl 

T5 

c3 

0> 

CZ5 

•S 

O 

s 

Oh 

fcj 

O 


Ph 

H 


< co 
^ -<u 
ti co 
G tctf 
. D _C3 
co i CX 

•^■4 ■■ •= -— j- 

co ^5 
G * P 

o w 


T3 >. 

<D 1> 

-1 > • 1—4 

c3 o 
^ ta 
a « 
o <d 


£> 0/3 
P rS 


,0 -S 1 

5 ^ « 
t* <*-■ 

> -73. -2- 

i"~'o; 

1 1 a 

| .O > wi 
r' o t_i 
^ c2 
* §!%: 
.S :§J 

ftf CO 

SI' 

^ jp : 

c2 2 
tf -‘- <3 
CO O 

T3 

L-, t* 
-rt P 

§ 2 

to § 

CO 03 : 

D O 


>®BBS 


;%£s 


" A: ,®3!1 

v\z - • fcL : ^». ¥3?bVMcJ 

L : ~ ' ' v-- • ".- •’• '* C- 

■ 


> O 

Cu +-> 

0> co 
r; <L> 
>3 CO 

~ 5 

G *£ 
O G 
’S 

^ cs 
cd 

wj r, 

1 1 

_ - CO 

g*o 

O ’g 

2 s 

G c 


: & J 3 

■< «-, o 
Cl, o 

&1 
Cl, c3 

co jft 

«:& 

•o °> 
o o 
o rp 
C Q, 

.S3 £ 

8 , 

*S 2 

S •s 

o, S5 
Cl, 13 
P <D t 
co c 

C O 


i 

- J iSZf?v . ^* : 3J 

xsit 

-immzml 




V ^:*5S/ 
— ■ 

v j. 

.-.r.-.v-r 1 * 


265 





WWrrfi 

,mm I 




m 



wm 


*■*&& } •; wwp. : * h 

wm/ 


*B ($M 

§ CA S0 


3 g s s*r- • JJ 

iMO 


-jg 
. g 2 




> .C-^^TLrt ^ *, JT1 -»'■ -J r . 


'-•••’ ■ ■£ ' : : •• fc ; -~ 

xn 

■c3' 

*73 

§ 


GO 

<D 

C/5 

O 

PH 

o 

Vh 

Ph 


ttNiW 

1 :: 




o 

”p 

§ 

p 

*c3 

fcl 

<1> 

H 


* g &N 
- Uh Os 

<1 s ^ 

t 2 ■? 

S .2 '* 
S e-g 

* & | 


31| 

;--e« \.. >.,. • 

e ^rf- '* 

■<_- ;/v* * - 
:- r - ' Ll ‘ - l & ' #?, , * I "" 

mteK5 

^ ;•' : ; v 

cs" 

-,;L O 

r . :'.2 

«> •?" ■:«'• 

<.-_< iv , 


1 m 

V c 

o 


W 




issii 


; -V 

'•: t ••>• . V 

a ; ; * 

W®m 


> • -f«r#sa 

V - ^ 

i. -r* > - r>*;. * ■>«! 


. cu 
<N W 


I *8 

9K- 
02 « 
z a ^ 

vi ^ 5 


266 


■&:: -s- ■ 

. o '"••-* .: ■•- -S''- :, *. r J ' *•* **" • 4 ■ r i Wk; ..* ■ 

r^ ; 7- v; ;.* ^ 

v? .'•" ^-' ’’ • ’^ r >. -;' Lr*sj=^‘? r - ' 


mMf. 

* mi 





"|g I ST^f; 

>•'.£ '2 ^:^H : l 


S A ^ o s * 

.T3 2 ,- S- - ~4iV 




g • 8 

O Ili * % "T“* r-: 


•v T. ^'A , --^r ,-s»; <-* ~ co 

■■rfer*** I *:*.1*A «... g . C s. 

> !** O K 

' £r: ipl?:fe #'f v§ f 

| & -g I 

"p ■'cd'^'iS'S^ g 8.f 

L_J » T •.*. . -4^-.-v*-- •• ' 2 o .*3 £ 

■' --v- -v-. cd cd *rd 

ctf wsf lfe ^ 

-O - | i g-£ 

C3 O 1 1 | i 

d e s s & 


00 

’■d 

a> 

CZ) 

O 

Pi 

o 

t-H 

Ah 


GO 

X) 

O 

X3 

§ 

a 

S 

fa 

a> 

H 


, o E 50 p CO 

ch c3 »- S « 

i-R-g -i J 

SS“|s 

cq o .Js £ "O 

1 s £ -0 £ 

<5 .s o £ g 

° S £■« « 

2 5 o ^3 X> 

- S ^3 g> 3 ^ 

2 c 3 o ^3 

E S 2 mS 

I M “"Si 

'a o« o g 
M £ 3 c « 

^3 CO c0 D 

U B « > *-* 

£ 1 s 's I 

o .s g fa 
<u 2 0 ^ § 

c E x> JH ° 

O p n Q, 

CO *- 03 n JD 


* cd 

S’f'Zv 


g f P £ € 

c5 o *— I f <U o 
P 4-^ r_r, g to 

£ s& R. &" 

5 c e ” S i 
3 2 £3 s 3 

1—1 o K C CJ fc 
• o o JG 9 
1— ' CB H o o ^ 


J ■ * o | $m 
■S| s«d 

O B - «g~ <j3siW 

— h -y 2 .5 o 

3 ^ 3 g 
« ^ c §3 & - Jlm 

rO -O •— ^3 .. Q?^RwB 

O l* o> _cj _. 


C 1> 
o . - 


§ i f 

-.“C rz +3 .2 

g 2 C "S -HM 

H Q-> fa ^ 4-4 

c c q «■; o-ssfi 
^ g<2 

g j.s § ®‘*a 

_fa cc <y S o tNII 

~o +Z 2 •- 3 'si"^ 

— i cu c3 _r- -i-> ?£>ia 

^ *T3 ^ o ; g 

>?'&' ts «aii 

5? w* n x> $3 q 

« -s ° s^.aP 


00 .fa O 

£ ^ 4> 

-c o w 


J3 S' co *3 

4J — 5 <D 03 

fe c2 O W) *3 

£ a ^ *n g 

S - ^ f? S, 

C/j • •> r/^ 

o u x S » 


<N on 


CO 

Cl, i*Si 

a> 

ro S?£ ' , i 

a 


cd 

tO 

on 

*o ?&«s( 

X) 


o 

e3 ',T:{| 


- <£T ' ‘ : i 




267 




hm 


Si: 

m 


’ ^»* ' ' * - Jt “ : ^' , ’~V 


•*-. 

iV 5 »* 


*=;■ •" it* - - •% '" ". ■ 

a> -•• Q co 

tevi i 


ii^.: 



gpj£|p^ 



o> 

•S .33® 


•:-rt ; •> .. V, ...O 3 0 '~ 


• ' vu m - v 

£ ,2 £tf|gg| 


•5 1 41 '^ £■:£ 

co co uj o *r 5ft O 

• m* :. .;*_ O O /■*. 




%m 

: G>S 

Tr-lttV;::: 


C/) 

*73 

c 3 

*d 

§ 


n 

o: 

<3 




c/) 


o 

"d 

§ 

a 

*3 

a 

<D 

H 


|S co c O > ;t3 £ <o 'Ui 
7 >> 8 ts o 2? § -° d &o 
h |S.s^ ? = -sg 

- § “ .§ ai .is * ■§ ‘s 

&■ e J^’E'O £ aj> § g 

IS : 3 g ^S-s|s 

“1«s8lIi'S 

C *0 CO m w o o> 
S wOfl)^^cjg> 
0'gco22 C) ^tP ? " -, 0 
’•C § 3 -a g .2 -£ 

= P^S c «^j 2 d 

■as. - & <3 fc£> D 


ScoOa>- D dcoS u > 
0^^5500 ^ ti ^ Q 
•5 g— 3 73 £ .2 <3.0 
= p^S c «vS td 
*^8 cC c2<ua>'£ 
^ |t 8 £> so 

? -g 2 5 g S S B..S 

co cO <D T3 di -y 73 -£ 

8 C C 1 o OD frt 4) p i 


{/3 W W m V 

W O XS |- -t ^ 

■s ^ <0 c.SPgiJ % 
« £ . T« C fe -g £< 

f " S ,t! o «» b t- W 


CL, . ^ w M-H (L> -tz £T 

rrt CO ^ Cm ^ CC Z> 

_ ” -g .ti o ^ u H w 

Q CJ ?. 2 r- 't! ^ to 

5i C C 5 O v> • O 

i 2 ’"1 . t ! ^ -2 _d o "2 


42 "1 B — £ J=> .2 ^ 

% S 3 *-S 8 -s 1 13 ! 

o. 2 S!^^r fi 

-O-^Ce 0 «aoM«§ 

c C .2 ‘C 6 « •- *3 -5 
; 2 |&gg.s§| 

E S 8 s* 80 1 'si -g 
ll^lo «•§ 

ES'OCLTDcncd 

' ] CCS O jj C O 

c^B-oSoSaon 


S 3 H w 

co c/i 
^ • O 

O fl M 

to 2 e3 


h r® »D O 4> Cd .C jjPB 

<< ig':’— ' xf%£- £ 00 3 -^S 

« 1 ><.f f S -s &mt 

s ^«*6 EvSSSi 

= 2 - inp E 3 f»p 

s « xx P § 


o ^ 

wi r> 

3 US' 

w *-« 


\o cn 


o 73.7^1 

d id ;®^IP 

♦ •— < • *-h • 7-. Kg*Jf 5?5 

T? 1 <D ' 

M Oh' 

2 i 4* 

S 8^ 

O O . ’’ j w 

° 

x> 8 *|f^ 

2 +-» 

. CO ;.:-^aaf»a 


)k ^5 J i SSI 

1, ^ g-s" 1, as 

.se^ig *wk 

c c il . o d 2 73 5 ®ai 

2 o d , S S .2 

ir> g b c .2 o fesS? 

§ i®, ^ S S 3 cl r 

■■» s s c s & -m 


(D g S O 

b .2 c s 

O M c c 
g 'Tri DO h 
c 2 a> 00 
v- a $5 u 

o s _ CO 

Ii !fi 

ES|i! 

© 2 d «* §* 
<u 3 *d — 
jg o £ .2 T 3 
« L- c ,-t; c 
js d <u d ■• = 
Ph W h d 


2 W 

.S |: 

© 2 

CO £ 
to o 
X> CM 

2 6 
CO c 

<u 42 

f 30 

tn * 

* * 


268 


*•.. * V- ^ i; ; ! ' J(f/< 


' ;: 0< : ~4 





%&&€n w 


Sfci-TT 


■ . ,*W. — 


B&wS-B 


C /5 C -O 4 *^ 

« « u 5 




: ; . : .~*'iu y-, -: ‘ 

-i>!?5^W' 


w.S r 1 n^r.csi 


i g - b 43 ' 5 ;;^sS 

felH :? '^©*i*iI i i 1 * i s^m; 1 1 ■« 

•• fK ' v - ' '•§ I g'sl-S : e 

H-H > CL> r • 1 ? £ = 2 3 . e ;;:,= -■ ■- 


C/3 

c 3 

T 3 

a 

aS 


•o £ Sr a* E 

© <C g a) aj 

MB S 2- h,.S 


c B) ,0 

T? '*— * ti — j 


M e g ” 

^ CO 5 

«“ r o .2 


00 

T* 

a-> 

03 

o 

Oh 

o 

»H 

Ph 


C/3 

X 

o 

X5 

a 

as 

a 

3 

fa 

<D 

H 


l-l 

cS 

cT: 

9 

<D 

Qh 

,cS 

JL) 

u 

LmJ 

u 


• ^4 

r-< 

O 

2 

3 


3 3 

fS 

2 

T3 

o 
• *~« 
4— » 

cd 

•£ 

d 
* *— » 

<D 

s 

cd 

H 

s-» 

3 

o 

o 

cd 

td 

*£ 

3 

a 

O 

o 

03 

O 

•»-H 

CO 

<D 

% 

^a> 

x> 

HD 

H 

<D 

p£5 


o 

c 

<D 

o 

d 

s 

3 

3 

cd 


>-* 

4-J 

c 

cd 

CO 

‘55 

O 

CO 

o 

o 

CO 

<D 

cd 

> 

cd 

C0 

X) 

O 


o 

JS 

t 

c 

o 

a 

CO 

cd 

<D 

L4 

T3 


00 

o 

4—* 

o 

«^4 
4 — * 

40 

Cd 

£ 


03 


c 

■ —* 

a. 

cd 

Cd 


0 

1 ■ 


• 1 — ( 
o 

4— > 

E 

<D 

> 

ta 

T3 

c . 

cd 



;?->V > - : ' ? ; 

Cd -, ~ V,* 

' s '“I- 

g o o 

W -. •n »o 

,:^* 2 ^ ' i*'* 

£ g ;.;e: 

a | , y :M 

© -g .:-?£ 


8&&k 

v M 

- 

rf^‘i^: -ii 

' 0-0 /in-' 

jrn (N |:, ; v 


ctf 




o in 

in — « 


1 * S 2 « a -S 


>> « 
« w 


4) +3 

«• w «tj ^ oo , O 

2 S t: x) ^ 

i; p p .2 ^ o t3 

S 5 S eo <3 T3 c3 


< ” g c a) ra c 

O .2 O CO r- «J 
4> *r **3 <+5 cd .5 ■*- 

2 J 3 « c d w 

g u c - a t T3 

■S E c G eS 5 « 

« I ‘c I « S § 

a &•- a | g s 

N | S 1 S C g 

M'a 2 3 S O 2 


g c 
o 

I- - 2 

o ® 

<S w 

flj Ch 

g o 
2 ^ 
S *53 

^ s 

o g 

g ^ 
£ cd 
C <U 

° fa 
in 

II, 

1 1 : 

W H , 


c O 

iCi 

Sc 

E | 

5b 

OX) 

W 0) 
pC ” 

o ^ _ 

O co ^ 

c o 2 

Sgc 

- §*2 

*| g S 
‘E *S P 

2 fe cfc 


H^ggj 


269 




*1&M 





j § 


v^;-.%c 


3« 

mm 


Qls 

O :S| 






p'#^>r 4 'jfe..Cv 

HU5S®»*jaL A ^ ff^' 

l'#te‘h-^ 


iiJ'll; 

^ 8 ,*C.;TO .S T\ 

i^fcnS o' 49 - 
i|gg v| 2 Id 

$§sS -£ c 2 

V-‘ *~^~ - t ‘^hft r- 1 ^ 

£|S '5 c a 2 


mm * 

KSjfewvttO 


C/5 

& 

§ 


SA®AI|PHg-.s i .g 

^i’t- fa S C o 2 

^liftetS?S§.:8 ■§. ® 

P8S^^^*S?# ; S -o .« 

Oa^Kpig-JI !e 

-H^,«l|lll 


58 " o-s 

sr s •g 5 
i s § i? 
IS 1 1 -B 

*73 ~o ^3 4-5 

o a> >» .s 


>g c^- 

'- p 1 " 

*i O ' 

,(N <* 

pd d 

S *ss 

*„d 
^ T3 
<N . S 

\*P» 

>5 (0 
& 1 43 
£ o 






®3l&!(9Hfl 


- JK* r*7ri- a-:.. .3%; ■■ ; :• r-----&c±»~ ■■&**■■* 

>< l^sfe fef; =£> 

o <L> 

3 41 :;-' ■: .?■ ■'- -fjV-. 


GO 

"Td 

0) 

C/5 

o 

Ph 

o 

?-h 

Ph 


C/5 

i-P 

o 

Td 

§ 

a 

*cd 

B 

a> 

H 


<2 e a 
t5 H3 


<2 ' : 44 r 4 -S?: : V ■?:&;%? 

*> - 

^ 4 i*llV 


:' m ^Mii & 0 $s&jl 

’■■'■■‘••v. vl 4 ?y 

^$m\ 

• H -r' \ 


O Hi 


m < 

% O 


& 

X •% 

of > 


■ s* ■!■$?£&** 
': : . • *?£•' . 1 • 

• : -^x -; ^ -v ;-^_ ^*^3; 








V-ir] 




1/5 ^2 
5 % 


03 C3 

c 3 c 


a) S 

x> ^ 

s .- 

<D (U 


r:ii 

::vf- 

4#! 


270 


■b 'ism 


. ^ g. ^ 


K, . 'ri. *■. :- . 


^j*VV Tj>5 







2 r -« -*§ *5) 8 

g.-s &S 'sj 


4J* -■* -fi t *'■*.'• */•.•••■ 

— ■«. ■ •>•*.. •;■ ■ ■■'■-- :,'X w*^- 4 'uS«v«fiif 






C/5 

ci 

a 

cd 


j^yp® ? 


00 

"73 

a> 

05 

O 

Oh 

O 

Vt 

Ph 


o 

"73 

a 

c3 

a 

S3 

P 

a> 

H 


« *5 a"0 « g - g c g 

a S s...s 5 « ^ ■» J § 


:g s & s -o g 5 * *s '5 ^ 

G t! o *^J WH) ' O 'O g 3 ^ 

a So. 2 .£'S *5 o i> « 5 
^ a *§ > £ f> f> 2‘C«J ^ 

I- 3 O cd g *- J- 3 o ot-73 

"O w j= os ir ^ oft cs « 


50 0 7* > > co w C ~ 

otrj oooo <d >< § r; 


« -5 J> = « o 

(S^-S 

3 •p ^ <£ i) 2 ^ "d ^ « 5 

CX « O • ~ -C E g, C M c |> 

E o £P £ H ,u w 01 S -2 Jr 

orgs •SPCcScd’5 
u b2 3 8,g o g'S S g 

, S w c « B ft ~ « a -O 

_cn < ^/-\t | C0pPOO(D 


>, rt 


5 ~ g s •SPcc^td’S 
U bs 3 & 2 o g 's g g 

; « “ o « el I o 1 

51 ^ rA n h— » C ^ ^ CO n 

s s e|-§ I^S S 8 I 

i«!'S»'8 2S .2 § -2 


o O H 

« ■* 


E « g|-o i^g'3 8 

b'2^'5rti(£ CTi «oo 

£ ’o ts " ,2 TT c -2 *c 01 

S»°-E «3 o 

© w ^ +-* Cd*OT^ >-0 

s e 1“-§2 B o| 3 


S e!“^ 2 B»| 3 g B 
Jo 2 x. " ^.S-vr E § B 

^ajococPScoS^r 1 
G ic o •= w •§ SiJ’SiJ >? 
*3t?Q.° 2 « !2 « c 5 O 4 


•2 05 c 2 a> 6 

■RSfi^S 


O p §" *q fc 2 *2 2 O cd cd Cl, 

« o 1 ^ 2-5 § .s 0 ^ 3^. 22 

Sf S “ 3 s .S c M ^i-§2 

2 r "’g “ g» c g's c S 
^ 1 ^ §3 .2 t ■ « 5 eo 


S^’220cd<d0 
« rS C C o T) S c« 


_ W -—a 

2 r ^ 

»■* >>» Jr 


« -o .2 CO 

CO 0) CO £ 


w — w u-/ 

O | cx ^ 12 

(3 S 3 ? « 


a jf S g « |? «g|-| 

^ «>.2l o f a1-§ fel 

(NcjcnCOcoooOaJOT^ctf 


#5|S 

- . - ! ^L*r-'* i -i V ; 1s^. Jc7 

«;S1 

“ TL'T 

■v^^JJ 

■■ -:^m 




§swm 


FI 


4 




O cd co 




- .■ . -v - - .^L;- . ■•: ' 


■ i*^: • v s k-v . *.“ 


• O ; : .-v Pm 

<w . ^‘ . oo ‘ ■ 


Ig ? 

5 a.-m^-:^ 




"atSjsfeS;, ’trt IS 

: : r’v*^C 


»r> 


•^I : 


13 

d 

4-* 

*— » 
3 

OX) 

c 


j-t 

Q 

J-« 

3 

<D 

c/T 

o 

«-T 

1 

o 

3 

4-» 

on 

cd 

C 

<u 

0) 

> 

3 

o 

<u 

13 



<u 

d> 

rr 

cd 

cS 

s 


3 

d 

-4— » 

C/3 

cd 

4-» 

2 

Q 

o 

pC 

cd 

GO 

3 

o 

cd 

i-m 

fs 


pO 

<D 

J3 


C/3 O 

(« o *-* ■*-» „ 

GJ .y a> c/3 T3 

^ jc: > o c 

3 cu B <-> cd 

« 2r S .g « 

^ o S = § S 

*5 &-o 2 

S 3 S •* ' 


£> 

g J3 
"O .tS 

2 * 

P. W) = 

II 

(u^-^^-oOCuq 

« ^ - s S 2 ;2 -.g 


o fa;- 


*’•. v *r*? ~i v»> 

*£^ii 

^cd H 


W 

Q cd ^_ 

M .2 5 g 

3 o ^ cS 

- O o 13 «f H 

C C (H 

c« ^ rj O 

D on b - 

O ^ c- ■ <u <D 

eg cd p eg u u 

ts ■s s £ <2 s 

^ P. CO OX) u 

O 3 1) J3 J- 

„ 4-J 4-h <D 

oi) £ ‘on £ 

d EL £ 

^ <jT j: 2 *ri 

g Cte 2 jjL, 

S 8 £ ° 9 

ea g 5 b> js 

■cs £ 2 


<u cd 
*C *0 


C/3 


CD 

I 


H 


S3 


<D 


G <u 

W H 


S3 ra 


272 





6 -C>3> 


t/ip 


fea- 




sxfci • 

feta. 

Esc* J 


2 o . 

AS £ 

CO *£j Cd ^^^£2$'*;Jcf--.'--‘:-- 

-is ^ ^ #’ : 


^*‘ H GD r* 

•© \e 

r-* -.«i • 



py -m wstemsm. 

fes®-. 2 •• P~ O J2 

.m § p 
^10 > g i_j <u 

i3 C hj «o‘"' * O "*• 

• -4 *. pt — 4-* • r^ .ii-:,i2^;-i- r- : : . 

atf%f!K. C ,B ^ ; • • r-j-z&int ^fe-Tr.'Vw.-r;- 




^PfS h.2 

:SS^^S-:s 


es> 

*-<— 1 fc etf' - , 

jo “ ' - 

:; ■'O <D 

■•5 c 'gS&i^J^R 
■S? ■§ ig£S:<$j$MfteM 
5 :g. t£tfel9©i 

O .5 SfeSaSBSSS*^-:^ 


SMpPp-; g .fa fa ...w - . ^«tp« 

1 •SiHfti: 

03 44 ~nt ■ 

>/» :: G o > O Sfel&fe : .' 


^K^g^^g.;:a -p 

o ■§ 

^mmm ^ ns 2 


«liSS§S®l 

2I18S 


d “o 
B w 

O cd 

fa C 


o 

§ 


Qy 

o 

•q > 


rv ^ d 
° 

cs £ 

<* C ja 

a *c3 £ 

^ E o 

o H c 
. s 


?J&§ : ; 

v-i ■ vs 

0 6 
W (D 

w j-» 
0> 00 


43 T3 

4^ c3 

4h T3 


cj O h c ; x cd 

C oo t: o > 

^3 ^ bs ^iS ^3 ^ 

§ | $ C 1 t 
g 3 (2 “ -o .| 
«gs58e 

S .SP £ “ e* 

O obrT 43 *c 

, c ^ o pj £ 

- -p ’O (U O 5 

s £ i2 | ^ 8 

o £ ’■5 B 2 

■m c B *2 *d 

? O C ^ w S 

« 0 o 60 £ g 

-O O CJ C O 5 

*S £ <m '> ^3 > 

C *r- O o ^ M 


« 5 

c *d 

r°s T3 


2 >r 

fli -M 

2 co 

S 8 

O * 

mO 


2?’E 

4-> cd 


4-> ZS '^4/ 

O -d 
.p5 4-* T3 

a. w « 

00 « 8 
£ o g 

> -£ > 
O o ^ 

E X) cd 

O 4-* 

« £ o 
i> o fa 

U S ft 
c/3 4-1 p 

53 gs M 
r d z) 

^ g *> 

co cd 5> 
O ^ O 

— cd co 


• pMM _1 Cd CO 

5 co fa c/3 cd 


^ o 

.5 > 

cn 4> 

d tj 


g 

# «4 ./u 1 - •:» '■ IPr*"*- »V*7 T - ' 

rd ■ v iS^'<«e, 

■ ■ r. 


to' ^ 

.s^ 

o § 

Urn 4-> 

DO « 
J5 










Shuttle Radar Topography Mission 

Background 
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Sponsored jointly by NASA and DoD’s National Imagery and Mapping Agency 

Objective is near-global digital topographic and image maps with 30 meter resolution, data 
set delivered by 2000 

Manifested on STS-101, Sept., ‘99 
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ADVANCED RADAR TECHNIQUES AT JPL 

PRINCIPLE OF INTERFEROMETRIC 
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RADAR INTERFEROMETRY 

THEORY OF SPATIAL BASELINE CONFIGURATIONS 
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sin(a-0) = ((p+8)**2 - p**2 -B**2)/(2*p*B) 
z(x) = h - p cos(a) cos(a-O) + p sin(a) sin(a-0) 


SRTM HARDWARE 
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SRTM OUTBOARD ANTENNA FULLY DEPLOYED 







FUTURE TOPOGRAPHIC RADAR MISSION 
WILL MAP 80% OF THE EARTH 

ShU i tk n y ssi0n schedu,ed ^ be flown in May 2000 will carry a specially modified radar system 
will produce the most accurate and complete topographic map of Earth’s surface ever assembled. 

prolect^tween NASA^Tth^nf ^ w"” 1 * T ° P ° graphy Mission ( SR ™>- is a cooperative 
p oject between NASA and the Defense Mapping Agency of the U.S. Department of Defense A formal 

memorandum of understanding to develop and conduct the mission was finalized on July 8. 

The mission is designed to collect three-dimensional measurements of nearly 80 percent of the Earth's land 
surface except near the poles, with an accuracy of better than 16 meters (53 feet) The regions toTe 
mapped are home to about 95 percent of the world's population. 

SRTM will use the same radar instrument that comprised the Spacebomelmaging Radar-C (SIR-C) that 
flew twme on Space Shuttle Endeavour in 1994. To collect the topographic images engineers win add an 

nlv JatoXvices°” g <20 °' fOOt) maSt ’ addi,ionaI C - band iraa * in S “Knnas, and improved tracking and 

The mast which was developed using the design for the truss structure of the International Space Station 
will extend sideways from the orbiter’s cargo bay. The antennae at the tip will allow 
stereo-like radar images of Earth's surface through a technique called interferometry. Such space-based 
interferometry was successfully tested during SIR-C's second flight. P 

Scientists will then use the 3-D images to generate computer versions of topographic maps called digital 
elevation models, that can be used for a large number of scientific, civilian and r^lita^TppSons! 

measurement f fr °m weather satellites, the topographic infcrmationproduced from this mission 

NASA P 6 m o m ^ US ® fu ! data set about Earth that NASA ha « ever produced," according to 
ASA Program Scientist Dr. Miriam Baltuck. "Possible applications range from scientific uses such as 

planetaiy geophysics or hydrologic drainage system modeling, to more realistic flight simulators for 
b^ck^cke^' ’ t0 COmmerdal USCS Hke locations for celIuIar Phone towers and improved maps for 

t0p T aph , iC maps have 15660 generated from stereo pairs of photographs acquired from 

hlfnk^K n de r i In aft and Sat , el u teS - However ’ such optical s y ste ms cannot penetrate the cloud cover that 
kets nearly 40 percent of the Earth’s surface. In some tropical regions the cloud cover is virtually 

continuous and, as a result, significant portions of Earthis surface have never been mapped in detail 

® ,0bal maP ° f ^ CnUS than We d ° for the Earth *" said Dr Michae l Kobrick, co-originator 

clouds S S^^ at ^ ASA ’ S Jet ?T °P ulsion Laboratory. "Since radars can see right through 

clouds, SRTM s 11 -day flight will give us enough data to produce an image of the Earth 30 times more 
precise than any that currently exist - and the best part is that the image will be in 3-D." 

requiWnTforTdidf Fairfax, VA, plans to use the radardata to fulfill a joint defense 

meterTnOO feet) DMA T u T°V ™ P With data P ° intS Spaced a PP™imately every 30 

(100 feet). The DMA currently holds a digital terrain map over 65 percent of the Earth's land mass 
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with data points every 100 meters (330 feet). Completion of this data set has been hampered by a lack of 
cloud-free photos over major portions of the world. 


The SRTM mission will be implemented by the Jet Propulsion Laboratory for NASA's Office of Mission 
to Planet Earth, Washington, DC. 


7/15/96 MAH 


#96512 


PUBUC INFORMATION OFFICE 
JET PROPULSION LABORATORY 
CALIFORNIA INSTITUTE OF TECHNOLOGY 
NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 
PASADENA, CAUF. 91109. 

TELEPHONE (818) 354-5011 
http://www . ip l. nasa. gov 
Contact: Mary A. Hardin 
July 15, 1996 
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What is SIR-C/X-SAR? 


SIR-C/X-SAR stands for Spacebome Imaging Radar-C/X-band Synthetic Aperture Radar SIR-GX-SAR 
ts an imaging radar system scheduled for launch aboard the NASA Space Shuttle in 1994 It conidsL ofa 
radar antenna structure and associated radar system hardware that is designed to fit inside the Soace 

Ah r 80 b cT “ e '° ff ' the car «° ba 5’ *"» closed as seen in Ute g?apit!c ™the next page 
After the Space Shuttle has reached a stable Earth orbit, the cargo bay doors will be opened the antfnna 
stmcture wfl be deployed, and SIR-C/X-SAR will be switched™, toVgTnuun^ 
technology to image the earth s surface. Radar images generated by SIR-C/X-SAR will be used bv 
scientists to help understand some of the processes which affect the earth’s environment such as^ 
“ 0n In * e Amazon - desertification south of the Sahara, and soil moisture retention in the 


Deploying SIR-C 



Space Shuttle doors closed 



Space Shuttle doors open, showing SIR-C/X-SAR antenna 


The SIR-C/X-SAR Project 


SIR-C/X-SAR is a joint project of the National Aeronautics and Space Administration (NASA) the 
German Space Agency (DARA) and the Italian Space Agency (ASI). It is the next step in a series of 
spacebome imaging radars, beginning with SEASAT in 1978, continuing with SIR-A (1981), Germany’s 

"“' “T Experiment (1983), and SIR-B (1984). It is a precursor to the Earth Observing 
System (EOS) imaging radar system planned for the end of the decade. 


Science Objectives 
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SIR-C/X-SAR's unique contributions to Earth observation and monitoring are its capability to measure, 
from space, the radar signature of the surface at three different wavelengths, and to make measurements 
for different polarizations at two of those wavelengths. SIR-C image data will help scientists understand 
the physics behind some of the phenomena seen in radar images at just one wavelength/polanzation, such 
as those produced by SEASAT. Investigators on the SIR-C/X-SAR Science team will use the radar image 
data from SIR-C/X-SAR to make measurements of the following: 

□ Vegetation type, extent and deforestation 

□ Soil moisture content 

□ Ocean dynamics, wave and surface wind speeds and directions 

□ Volcanism and tectonic activity 

□ Soil erosion and desertification 

SIR-C/X-SAR Instrument Description 


The SIR-C/X-SAR antenna structure actually consists of three individual antennas, one operating at 
L-band (23.5cm wavelength), one at C-band (5.8cm wavelength) and the third at X-band (3cm 
wavelength). The L-band and C-band antennas are constructed from separate panels that can measure both 
horizontal and vertical polarizations. 
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The SIR-C/X-SAR antenna is the most massive piece of hardware (at a total of 10,500 kilograms) ever 
assembled at the Jet Propulsion Laboratory, and measures 12 meters by 4 meters. The SIR-C instrument 
was built by JPL and the Ball Communication Systems Division for NASA and provides the L-band and 
C-band measurements at different polarizations. The L-band and C-band antennas employ phased array 
technology, which allows the antenna beam pointing to be adjusted electronically. The X-SAR instrument 
is built by the Domier and Alenia Spazio companies for DARA and ASI and operates at a single 
frequency, X-band. The X-SAR antenna is a slotted waveguide type, which uses a mechanical tilt to 
change the beam pointing direction. 

SIR-C/X-SAR Image Data 


During a week-long Shuttle flight, SIR-C/X-SAR will image an area of roughly 50 million square 
kilometers of the Earth’s surface. This corresponds to a total of 50 hours of data. The peak data rate will be 
225 megabits (or 225,000,000 bits) per second. The data collected will be processed into images with 
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“.f lec : able i rom '° t0 200 me,ers - Tl " widIh of the area mapped out by the radar will vary from 
o 90 kilometers, depending on how the radar is operated, and the direction in which the antenna beams 

“2, T SIR ' C f ' * AR Wi " bC USed t0 devel °P au,omatic Uniques forextSg 

information from radar image data, m preparation for the EOS SAR mission later in the decade. 



This schematic diagram shows the SIR-C/X-SAR antennas illuminating an area on the ground and 
mappmg out a swath as the Shuttle moves forward. The area shown is a SEASAT image of Los Angeles 
California. North is to the right of the image shown. 8 ’ 


More About SIR-C/X-SAR 


The Shuttle Imaging Radar-C and X-Band Synthetic Aperture Radar (SIR-C/X-SAR) is a cooperative 
space shuttle experiment between the National Aeronautics and Space Administration (NASA) the 

, SpaC f c A .^ en c cy (DARA )« and the Italian Space Agency (ASI). The experiment is the next step 
forward in NASAs Spacebome Imaging Radar (SIR) program that began with the Seasat Synthetic 
Aperture Radar (SAR) in 1978, and continued with SIR-A in 1981 and SIR-B in 1984. The program will 

t0TC ? PSAT ’ J 1111581011 to measure topography globally, and the Earth Observing System 
( S) SAR later m this decade. The program also benefits from experience gained with the Magellan 
Mission to Venus, other international spacebome radar programs (e.g. ERS-1, JERS-1), and prototype 
aircraft sensors such as the JPL Airborne SAR (AIRSAR). 

SIR-C will provide increased capability over SEASAT, SIR-A, and SIR-B by acquiring digital images 
simultaneously at two microwave wavelengths ([[lambda]]): L- band ([[lambda]] = 23.5 cm) and C-band 
am aJJ — 5.8 cm). These vertically- and horizontally-polarized transmitted waves will be received on 
two separate channels, so that SIR-C will provide images of the magnitude of radar backscatter for four 
polarization combinations: HH (Horizontally-transmitted, Horizontally-received) W 
(Vertically-transmitted, Vertically-received), HV, and VH; and also data on the relative phase difference 
between the HH, W, VH, and HV returns. This allows derivation of the complete scattering matrix of a 
scene on a pixel by pixel basis. From this scattering matrix, every polarization configuration (linear, 
circular or elliptical) can be generated during ground processing. The radar polarimetric data will yield 
more detailed information about the surface geometric structure, vegetation cover, and subsurface 
discontinuities than image brightness alone. 
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Germany's imaging radar program started with the Microwave Remote Sensing Experiment (MRSE) flown 
aboard the Shuttle. This X-band radar was flown on the first SPACELAB mission in 1983. The program 
was continued by development of the X-SAR, for which cooperation with Italy was initiated. X-SAR, will 
operate at X-band ([[lambda]] = 3. 1 cm) with VV polarization, resulting in a three-frequency capability for 
the total SIR-C/X-SAR system. Because radar backscatter is most strongly influenced by objects 
comparable in size to the radar wavelength, this multi-frequency capability will provide information about 
the Earth's surface over a wide range of scales not discernible with previous single-wavelength 
experiments. 

SIR-C/X-SAR Instrumentation 


SIR-C will provide multi-frequency, multi-polarization radar data. The SIR-C instrument is composed of 
several subsystems: the antenna array, the transmitter, the receivers, the data-handling subsystem, and the 
ground SAR processor. The antenna is composed of two planar arrays, one for L-band and one for C-band. 
Each array is composed of a uniform grid of dual-polarized microstrip antenna radiators, with each — 
polarization port fed by a separate corporate feed netw ork. The overall size of the SIR-C antenna is 12.0 x 
3.7 meters and consists of three leaves each divided into four subpanels. 


Model of the SIR-C/X-SAR antenna 



Unlike previous SIR missions, the SIR-C radar beam is formed from hundreds of small low power solid 
state transmitters embedded in the surface of the radar antenna. By properly phasing the energy from these 
transmitters, the beam can be electronically steered in the range direction +/-23deg. from the nominal 
40deg. off nadir position without physically moving the large radar antenna. This feature will enable 
images to be acquired over a wide range of incidence angles. 

X-SAR will provide VV polarization images using a passive slotted waveguide antenna measuring 12.0 x 
0.4 meters. Other X-SAR components include a traveling wave tube as transmitter, an exciter, receiver, 
and data handling subsystem. A mechanical tilt mechanism will point the X-SAR antenna to angles 
between 15 and 60deg., in the same direction as the L-band and C-band beams. 
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Both SIR-C and X-SAR can be operated as either stand alone radars or together. Roll and yaw maneuvers 
of the shuttle will allow data to be acquired on either side of the shuttle nadir (ground) track. The width of 
the imaged swath on the ground varies from 15 to 90 kilometers (9 to 56 miles) depending on the 
orientation of the antenna beams and the operational mode. Table 1 presents a summary of the 
SIR-C/X-SAR system characteristics. 

Table 1: SIR-C/X-SAR System Characteristics 


PARAMETER 




Wavelength 

0.235 m 

0.058 m 

0.031m 

Swath Width 

15 to 90 km 

15 to 90 km 

15 to 40 km 

Pulse Length 


33.8, 16.9, 8.5 us 

40 us 

Data Rate 

90 Mbits/s 

90 Mbits/s 

45 Mbits/s 

| Data Format 

8,4 bits/word 

8,4 bits/word 

8,4 bits/word 


(8,4) BFPQ 


(8,4) BFPQ 1 


BFPQ = Block Floating Point Quantization, a form of data compression from 8 bits per sample to 4 bits 
per sample. 

SYSTEM PARAMETERS: 


Orbital Altitude 
Resolution 
Look Angle Range 

Bandwidth 


225 km 

typically 30 x 30 m on the surface 
17 to 63 degrees from nadir 
10, 20 and 40 MHz 


Pulse Repetition Rate 1395 to 1736 pulses per second 
Total Science Data 50 hours/channel/mission 
Total Instrument Mass 1 1 ,000 kg 
DC Power Consumption 3000 to 9000 W 


Imaging Radar Home Page 
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COMMENTS ON DATA BASES & SYNTHETIC VISION SYSTEM 


by Dr. George C. Chang, Aviation Consultant 
at the Second Synthetic Vision Workshop 
at NASA Langley Research Center 
January 27-29, 1998 


(1) Due to significant differences between low-end General Aviation (GA) aircraft and air 
carrier large transports, in terms of aircraft construction and operations, more than one 
synthetic vision system will be required to serve various segments of the aircraft operator 
community. Some of the resulting systems may meet the needs of the low-end GA, while 
other more sophisticated ones may more appropriately address the needs of large transports 
carrying several hundred passengers over thousands of nautical miles. As an illustrative 
example, there must be freedom, for some aircraft operators, to choose between systems 
based on a less costly 2-D terrain database and those more expensive 3-D types. Similar 
choices should be available in terms of display methods, operational simplicity, etc. 

(2) The resulting airborne synthetic vision systems need to deliver economic benefits in 

addition to safety benefits originally envisioned. To achieve market penetration/user 
acceptance, system capability for beneficial operational applications must be carefully defined. 
Examples of beneficial applications include: (a) Avoidance of Controlled Flight Into 

Terrain/Obstacles, (b) Selected aspects of Free Flight including Curvilinear Approach. 

(3) The resulting systems need to fit into future aviation infrastructure with respect to, 
among others, (a) National Airspace System (NAS) architecture, and (b) air traffic management 
(ATM) operational concepts/flight procedures. International harmonization also becomes a 
must as system applications grow geographically. 

(4) The resulting systems need to be affordable, capable of doing the job in a cost-effective 
manner, maintainable with ease, and user friendly with acceptable level of training 
requirements. 

(5) To be effective, one needs to take an evolutionary approach to developing and 
implementing synthetic vision systems. The approach is to "build a little, and test a little, ..." 

(6) Collaborative development work involving stakeholders in the aviation community can 
go a long ways to ensure program success. Early involvement is a must. History of avionics 
development is full of successes, "white elephants", and failures. 

(7) Human Factors considerations are a must in synthetic vision system development. 

(8) System engineering approach is essential to successful development of synthetic vision 
system, while taking full advantage of user experience and expectations. 
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(9) Meaningful system requirements can be gleaned from many documents, such as FAA 
Advisory Circulars, ORDERS, Operations Specs., ICAO/RTCA publications, among others. 

(10) Airborne Databases may include those for: 

— Terrain, Obstructions, and Noise Abatement 

- IFR and VFR Moving Maps, Special Use Airspace, Instrument Approach and Airport 

Surface 

- NOTAMS 

- Aircraft Systems and Performance 

(1 1) Good 2-D and 3-D terrain and obstacle database displays may enable predictive CFIT 
protection, while Moving Map displays may facilitate aircraft VFR and IFR operations, including 
instrument approach and airport surface movements. 

(12) Synthetic vision overlay displays may increase airport capacity during low visibility 
operations. 

(13) 2-D or 3-D topographical terrain elevation and obstacle data bases can be displayed to 
the pilot along with aircraft GNSS position. Aural warnings can also be used to alert the pilot. 
Some professionals have indicated: "Additional enhancements to this basic information display 
might include a concurrent display of escape guidance information superimposed over a 
combined terrain and moving map display. Unfortunately, before such systems can be relied 
upon for more than just a source of advisory information, there is a fundamental need for 
certifiable terrain data bases." To date, there are no published aviation standards or design 
guidelines with which to approve electronic data bases for air navigation. 

(14) Some professionals have also indicated: "There appears to be a need for an extremely 
low-cost predictive CFIT protection capability for [in particular low-end] GA users. In this 
regard, a possible implementation might be nothing more than a display of the minimum sector 
or vectoring altitudes superimposed on top of (or below) a GNSS moving map display. It was 
also suggested that "For this GA application, consideration should be given to draping cultural 
data bases over terrain models to provide more information on such things as names of 
various forestry, lakes, vegetation, rivers, roads, railroads, state and county bordrs, and other 
'synthetic VFR' information." 

(15) On January 1 5, 1 997, Vice President Al Gore, Chairman of the White House Commission 
on Aviation Safety and Security, announced the public release of National Imagery Mapping 
Agency (NIMA) terrain data. According to some professionals, "these data will provide 1,000- 
meter terrain postings for about 60 percent of the world's surface, along with higher accuracy 
terrain data within 50 nautical miles of 450 selected airports. 

(16) Some aviation professionals have suggested: "An obstruction data base is needed to 
complement the above terrain data base. As envisioned, this new electronic data base would 
consist of airborne and ground site survey data of all man-made obstructions within, say, 

1 00,000 feet of the departure end of runways. Data would be used to enhance aircraft safety 
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as well as to allow operators to add payload. For example, data could be used to reduce an 
aircraft's second segment one-engine inoperative climb gradient requirements. This would be 
especially helpful in mountainous areas and at airports located in an obstacle-rich environment. 
Information could be displayed in the cockpit (such as overlaid on a GNSS moving map or 
head-up display) to help flight crews adjust departure profiles, thus allowing them to avoid 
hazardous obstacles within the departure corridor. Revenue payload could be increased 
because the climb gradient could be sited for each specific airport/departure runway 
combination." 

( 1 7) To facilitate aircraft surface operations during low Runway Visual Range (RVR) conditions 
and at night, some professionals have pointed to the careful use of airport data bases: 
"Terrain, man-made obstructions, and other 3-D airport data such as information on the height 
of terminal buildings, hangers, and even aircraft, could be displayed to the pilot(s)... Own 
aircraft position data would be derived from GNSS data. ADS-B (Automatic Dependent 
Surveillance-Broadcast) data linked information would provide data on other aircraft. Use of 
this information would enhance night and low visibility operations, making the overall surface 
movement system more fault tolerant, and would provide redundancy and other benefits that 
would support the development of advanced surface movement guidance and control systems 
(A-SMGCS)." 

(18) With regard to graphical depiction of noise sensitive areas for use in noise abatement 
arrival and departure procedures, some aviation professionals have suggested that: "Data on 
noise sensitive areas could be stored in an aircraft's resident electronic data base, then 
displayed as an overlay prooduct on an aircraft's GNSS moving map display. Using data link, 
air traffic controller could then electronically 'shift' these noise sensitive areas (and 
accompanying approach and departure corridors) during any 24-hour period to reduce the 
ground-based cumulative noise exposure levels." Obviously, some noise sensitive areas may 
feature certain terrain/obstacle data deserving appropriate attention within the context of CFIT 
avoidance. 

(1 9) For the standardized curvilinear approach mentioned in Paragraph (2), some professionals 
have suggested that: "This proposed use of several electronic aviation data bases that 
synergistically work together comes directly out of the [RTCA] Free Flight Final Report. It 
makes use of data bases which contain terrain, obstruction, and published noise abatement 
data, then combines the data with prior aircraft- or ground-reported, data-linked winds aloft 
information... Benefits include reduced flying time to a point-in-space that is generically 
referred to as the GNSS Extended Final Approach Waypoint (EFAW)... Using this concept (in 
conjunction with a cockpit 'tunnel-in-the-sky' display presentation), only one approach 
waypoint along with one missed approach waypoint would be associated with any given 
runway, thereby reducing the need for multiple waypoints - a safety factor that would result 
in less chance for charting errors. At low activity airports, aircraft would be allowed to 
automatically fly an approach to the EFAW. At busy airports, the [advanced] ground-based 
Center/TRACON Automation System (CTAS) would be used to assign '4-D' data linked 
waypoints to precisely guide the aircraft to arrive at the EFAW at an ATC-assigned time." 
Such a GNSS standardized approach would enhance not only operational safety, but also 
efficiency and capacity. 
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Graphical Realtime Databases for 
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by Jens Schiefele, Ludwig May, Helmut Raabe 


Introduction 
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DB:Airport Database Creation 
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DB: Database Concept 
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II. Realtime Onboard Database Creation 

III. Database Server 







DB: High Quality Database 
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DB: Realtime Onboard Database 
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DB: Database Server 
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^ Flight Tests (in Germany) 
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Satellite Images - IKONOS 
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Combining Synthetic Terrain and 
Pathway-in-the-sky for Head-up 
Display 


Michael P. Snow 
January 28, 1998 


Combining Synthetic Terrain and 
Pathway-in-the-sky for Head-up Display 

■ Flight Display Integration Program 

- Five-year exploratory research 
program 

- Goals 

■ Meet two Air Force Needs 

- Operations in low/no visibility 

- Reduce CFIT 

■ Produce next-generation primary flight 
display 
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Combining Synthetic Terrain and 
Pathway-in-the-sky for Head-up Display 

i Flight Display Integration Program 

- Approach 

■ Allow pilot's attention to be focused 
outside the cockpit 

■ Display 3D information for a 3D task 

■ Focus on CFIT cause: poor or lost SA 


Combining Synthetic Terrain and . 
Pathway-in-the-sky for Head-up Display 

i Previous research 

- MILSTD HUD vs. Pathway 

■ Flight performance better for pathway 

■ Pathway preferred 

- VMC vs. IMC 

■ Flight performance with pathway 
equivalent regardless of visibility 
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Combining Synthetic Terrain and 
Pathway-in-the-sky for Head-up Display 


■ Current research 

- Pathway and Synthetic Terrain 

- Optimization of Pathway Symbology 



309 





310 




311 







312 



313 




314 




315 






Lynda Foemsler 
NASA Langley 



www.free-flt.com 

Free Flight Inc. , 975 North Michillinda Avenue. Pasadena, CA 91107 (626) 791 - 0400 
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Free Flight and Synthetic Vision 

for the January 1998 Synthetic Vision Workshop, NASA LARC 


The Origins of Free Flight (the computer program) 


The original 1980’s moving maps were simple. They had an airplane icon moving 
on a small display relative to a course line. Airports and VORs showed up as 
symbols. This was a great step forward over tracking a Course Deviation 
Indicator and a step up over an HSI, a sort of mechanical moving map. As a pilot, 
flight instructor (having taught private, commercial, instrument and aerobatic 
students) and someone in the computer industry, I followed this technology 
closely. Most of us knew this human interface could be improved. 

From the latel 980's until the early 90’s I kept expecting someone to develop a 
moving map with digitized aeronautical charts and a 3-D Terrain/Synthetic Vision 
display. And I waited, looking for this display. In late in 1992, with no such 
product in sight, I abandoned the wait and began development. The technology 
existed to do the job at a reasonable cost. 

The result was Free Flight, commercially released as a moving map program in 
May of 1996. It had a symbolic presentation, digitized charts and a 3-D Terrain 
display based on early Dept, of Defense DEMs (Digital Elevation Models). It was 
named in honor of the Free Flight concept, which the FAA is moving toward with 
Flight 2000. The name is also an expression of the goal of the product; a 
synthetic environment allowing a pilot to fly more safely from one point to another 
in IMC, as if flying in VFR conditions, and flying free of ATC control for most of 
the flight. We've had a first generation synthetic vision display for over a year. 

As a pilot, it never occurred to me to question whether or not we should have a 
synthetic vision display. It was obviously the way we should be flying. Synthetic 
vision may not be necessary at all times but when it is needed, it’s needed 
desperately and can save lives. I suspect that once it is properly implemented, it 
will become an indispensable tool to all pilots, worldwide. 

Each of Free Flight’s three modes, Symbols, Charts and 3-D Terrain, uses a 
separate source of data for it’s presentation. This provides a data cross check, 
one against the other. The Symbols mode is a vector display using a database. 
The Charts mode consists of digitized and geo-referenced aeronautical charts. 
The 3-D Terrain mode is built from elevation data in a DEM file. 
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GPWS and enhancement to 3-D Terrain 


In December of 1996 I was working on improving visual cues for the pilot to 
prevent CFIT. The result was a GPWS having paired “objects”, or vertical bars, 
spaced at one-mile intervals, adjacent to the projected flight path of the aircraft, 
presented in a realistic representation of terrain. The design created a visual 
perspective to the aircraft’s GPS altitude as well as a GPWS. As the aircraft 
approaches terrain, the vertical GPWS bars 7 miles out disappear into the 
terrain. Then those at 6 miles disappear and so on, counting down the distance 
to terrain impact. It’s quite effec t ive and the impending . collisi on becomes more 
obvious as the terrain is approached. This technique proved to be workable in 
flight tests and was shipping in the commercial produ ct th ree weeks later. 

We also added cones on the ground to mark airpor t jocations so pil ots could find 
the airports more easily. User waypoints were marked as yellow cylinders 
sticking up vertically out of the ground in the 3D space. When the user creates a 
waypoint, it is saved with the altitude of that lat/long from the DEM file. Many 
Free Flight users have found great applications for this simple feature. 


The 16 bit limit 


Free Flight has been a 16-bit program originally d evelo ped in the Mic roso ft 
Windows 3.1 environment on Intel 486 CPUs. We had to limit the terrain display 
update rate to give the computer enough time to create a new terrain display. If 
this had not been done, the computers we were using wouldn’t have been able to 
keep up with the GPS input they were receiving. We set the terrain display 
update to occur every 15 arc seconds of flight, or about every quarter mile. This 
worked out well because we use a 15-second DEM data in creating the display, 

A Pentium 233 MHz CPU can update a terrain display with a 13-mile view in 
slightly more than a second. This is fine for most applications. For example, a 
BIB pilot called me the other day and mentioned flying missions at 9 miles per 
minute at low levels. This version of Free Flight could keep up with him on a 
Pentium 233 system. He’d be looking ahead on e minute a nd twenty-six seco n ds . 
Free Flight certainly would not be recommended as his primary means of terrain 
clearance, but it would give him an idea of the terrain ahead and is of value in 
preventing CFIT. 

A 166 MHz Pentium takes almost two seconds per frame with a 13 mile forward 
looking range and would be slightly underpowe re d for the BIB missions. The 
pilot could reduce the complexity of the terrain rendering or cut th e viewi ng range 
down to 6 or 7 miles. Either or both actions would increase the display speed. 
Free Flight is pilot adjustable to optimize settings for speed or aesthetics. 
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The 32 bit opportunity - our state of the art 


We began moving Free Flight over to the 32-bit environment in the summer of 
1997. This gave us access to the power of 32 bit CPUs and vastly superior 
software development tools and programming methods. Our latest synthetic 
vision display runs between 3 and 21 frames per second on a Pentium 200. We 
have the speed to keep up with a space vehicle flying a reentry. The terrain 
module is near completion and we have begun integrating it into the main part of 
the Free Flight program. 

The GPWS has been changed and may not be in its’ final form yet. Our methods 
of terrain rendering have improved and there's more that we can do. We have 
vastly increased the number of objects we present in the terrain display to 
include runways, obstructions, navaids, etc., all of which are subject to change. 
We are “flying" in the synthetic vision space with a joystick. 


A few lessons learned 


The following points seem obvious based on my experience in developing Free 

Flight over the past years but perhaps I have been biased from the start: 

• A synthetic vision display should be the primary flight display. It does one 
thing exceptionally well; it reduces the possibility for pilot disorientation and 
confusion that can lead to further mistakes and build into an accident chain of 
events. The pilots “out the window” view with synthetic vision provides a 
natural and instant terrain awareness and orientation. Synthetic vision 
displays bypass the mental processes involved in interpreting and correlating 
many separate instrument alpha-numerics, a task which increases in difficulty 
during stressful times. 

• Synthetic vision can replace many panel instruments if properly done. 

• A synthetic vision display can not be placed (retrofitted) in the same space as 
an ADI/attitude indicator currently used in transport aircraft. That space is too 
small. The synthetic vision display needs to be large, 14”, 21” or greater. A 
HMD can create a virtual display 10 to 15 feet wide! 

• A good synthetic vision display can provide useful terrain awareness and is 
valuable in preventing CFIT, perhaps to the point of eliminating it. This point 
alone should reduce airline insurance policy expense enough to justify them 
funding synthetic vision development, certification and installation/retrofitting. 

• A good synthetic vision display can provide a better understanding of the 
terrain than looking at a chart, relief map and sometimes better than looking 
out the window in VFR conditions. 

• In mountainous areas a 1 5 arc second DEM terrain rendering provides better 
terrain awareness than looking at a Sectional Chart. 
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• Thirty arc second DEMs make the terrain look unnaturally flat, but are useful 
for terrain avoidance. 

• A good synthetic vision display has many other uses than simply preventing 
CFIT. It can provide information for navigation, provide information on 
weather, traffic conflicts, airport location, help firefighters, crime fighters, help 
students in classrooms and will have other uses we haven’t thought of. 

• Visual cues such as texture mapping are vital to show pilots how close to 
terrain they really are. 

• It is very easy to “kludge up" a synthetic vision display to the point of providing 
too much distracting clutter, reducing it’s usefulness. It must be kept as 
simple as possible. 

• We can get a 30-second DEM of this planet on one CD-ROM, with room to 
spare. 

Areas of research and development Free Flight should undertake: 


|. The HMD (Head Mounted Display). 

Free Flight was built for portability and for use in a wide variety of flying missions. 

We can rapidly develop a notebook driven HMD system, creating a complete ; 

package for synthetic vision applications in navigation, research and j 

development, testing and other areas. Free Flight is well positioned to do this. 

The concept is to create a wir e less HMD that can int erfac e with a carry-on 

notebook computer or can work with a flight deck system. While this is under j 

development, create the high-end thrust for transports and low e nd hardware for I 

general aviation. The notebook computer should have a small black box, which j 

rides along with it. The “ride along" sy stem wo uld contain a pr essure altimeter ; 

that can plug into the static system for accurate altitude readings, ring laser gyros 

to provide pitch, roll and smooth intermediate posi tions b etween GPS updates 

and a 12 channel GPS receiver. The HMD synthetic vision display should have j 

an aircraft vector so the pilot can see where the airpl ane is h eaded. The system 

becomes a carry-on avionics/navigation package with battery backup for an hour 

or more of flight if all on-board electronic systems fail. Parts of this package could 

also serve as a highly portable training system for pilots. ! 

HMDs are theoretically the best method of user interface, at this time. HMp§,ry, 

provide a pilot with “the big picture” in a way that no other dis play can. Vyith head { 

position sensors (sonic or infrared, not accelerometers) a pilot can turn his head 

and see through the airplane by looking in any direction. That’s a great freedom 

and how he gets the big picture. r - , • 1 

The technology for HMDs is just maturing to the point where they are economical 

and practical. HMDs offer the ultimate convenience because of their high degree j 
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of portability. They can be used with a notebook computer and easily carried on 
and off of the airplane. The notebook can be stowed with the HMD attached to it 
by a cable providing great cockpit freedom. An HMD could be plugged into a jack 
on the instrument panel to connect with a built in on-board computer or use a 
wireless input/output system with no cables at all. 

The HMD will have a microphone for voice control of Free Flight, without the 
need to use a mouse, keypad, joystick, or trackball. Voice command is the ideal 
user input at this time. Small LCD's suitable for HMDs are now available in 640 x 
480 resolution. In the near future, Micro Vision Imaging of Seattle with offer Laser 
Retinal Imaging which has near photographic realism and variable visual 
immersion. By using a visual input for each eye, a true 3-dimension effect can be 
created with simple computer logic. The new Universal Serial Bus and Firewire 
I/O ports on computers are very fast and will benefit head position sensor 
response time. 

II. The high end thrust. 

Free Flight can provide a short path to synthetic vision in transport aircraft 
because it is a second-generation product. By accessing the data on the Flight 
Management Computer and feeding it into Free Flight, many certification 
problems will be bypassed. We will not be changing FMC data; simply 
rearranging it’s presentation. The only new thing Free Flight would bring to the 
table is a working synthetic vision display. Everything else will simply be a 
different way of displaying data from the FMC. The steps to take are: a) Build an 
interface to the FMC via a ARINC 429 card installed in a Pentium based system 
so we can read the desired FMC data into Free Flight, b) Construct a highway in 
the sky using FMC inputs and construct other, simple pilot interfaces, such as a 
pitch ladder, heading display and a few other things, all with FMC data, c) Test 
the display in a flight simulator with pilots and modify it as needed, d) Test the 
system in-flight while working with the FAA towards certification, e) Add TCAS 
data so pilots can see and avoid potential collisions f) Add hazardous weather, 
including wind sheer, to the synthetic vision display, g) Add airport detail visuals 
for taxiing to the gate, h) Make final adjustments, obtain certification for the 
software and hardware as well as any retrofitting/installation of cockpit hardware, 
i) Deploy a workable system so that a pilot can fly in IMC and have the 
perception he is flying VFR. j) Add other items as needed in the future. 

III. The low end thrust. 

The resources of an FMC are not available in a light airplane or helicopter so 
we’d need to expand our database slightly and put together reliable hardware, 
probably driven by Windows NT 5. A program would be to: a) Fill out the Free 
Flight database with sufficient data to build a highway in the sky. b) Develop a 
dynamic highway based on the pilots flight plan, c) Integrate the B.F. Goodrich 
for TCAS information and the Strikefinder. d) Integrate a datalink to upload 
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weather information, perhaps from a commercial service ... while working with 
the FAA toward certification of hardware and software, e) Develop or integrate 
ring laser gyros to provide pitch and roll information, f) Complete certification of 
the software in a hardware package, g) Deploy the package. 

IV. Free Flight program enhancements. 

Future Free Flight enhancements to be implemented are: a) Texture mapping of 
the earth model with aeronautical charts, b) Voice control of the program, c) 
Complete the database with all available NOAA data in it and a program for auto 
updating the data, d) Build the highway, e) Interfacing with the Goodrich TCAS, 
the Stikefinder for Wx. or Michigan State University Jeff Burl’s GPS squirter 
through s-mode transponders and present them in the 3d space. Bad Wx 
can be laid over aeronautical charts, f) Create multiple resolution DEMs: 6", 15”, 
30”, 1’ and 5’ and integrate their use into Free Flight, g) Clean up of existing DEM 
accuracy to have them more closely match the real world. One method is to 
create a program to adjust the DEM elevation where there are points of know 
elevation, such as airports, navaids or the bases of obstructions. This is the 
quest for the Golden (perfect) DEM. h) Build special-use-airspace in the synthetic 
vision space, i) Develop a HMD as noted above, j) Develop a solid state ring 
laser gyro system for pitch and roll input to Free Flight, k) Do the same with a 
pressure altimeter for accurate altitude input (we currently depend on GPS 
altitude). I) Develop a touch screen interface until a HMD is ready, m) Calculate 
and display an aircraft vector so a pilot can see exactly where the airplane is 
going. 

V. Generate instrument approaches on the fly. 

This would partially be an implementation of the work Andy Barrows has done for 
his Ph.D. at Stanford University and include sophisticated 3D descent to 
approach flight path generation. Andy has successfully created a tunnel highway 
and flown it down to the approach. The concep t is that on ce we have terrain 
data, we can generate a descent path to an instrument approach down to some 
height AGL, at some point of lat/iong, heading in a desired direction. 


Some synthetic vision ideas 


The Synthetic Vision Display 

• The presentation of terrain, and wha t should be in it, should be developed 
iteratively. There may be a need for the pilot to “personalize” his display. 
These two points compliment each other. Features may be added to the 
terrain display and then switched off or on for subjective testing by pilots for 
example, an artificial horizon overlay. 
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• The display size should be as large as possible to more closely mimic out- 
the-window viewing. HMDs can do this with aplomb. 

• As many visual depth cues should be employed as possible without cluttering 
up the display. 

• Should display hardware be head mounted, panel mounted, a HUD, a carry- 
on notebook, etc.? The answer may be dependent on the stage of 
development of the technology, the aircraft category and the political 
acceptance of technologies by the FAA and airline management. 

DEMs (Digital Elevation Models) 

• The accuracy and resolution of the DEMs are the two main factors of 
concern. Thirty arc second data is suitable for CFIT prevention. Accuracy can 
be vastly improved using programming techniques and manually editing the 
DEMs. Hopefully the ’98 Shuttle flight will yield a worldwide accurate DEM. 
Computer power limits the use of ultra high-resolution DEMs. 

• Multiple resolution DEMs offer great flexibility. On final approach and landing 
use 6” DEMs. At low levels, say below 3,000’ AGL use 15” DEMs. Above 
3,000' or in Victor airways use 30” DEMs, above 10,000’ T DEM, above 
18,000' 5’ DEM. With thinner DEM resolution the rendering range increases, 
appropriate for the higher altitude. Five minute DEMs can be used to render 
the planet for a viewpoint from space. 

Computing Power and Software Tools 

• As of January 1998, we have enough computing power on IntelM/indows 
‘95/NT platforms to do a good job with synthetic vision. Due to the increase in 
CPU power coming, with improved operating systems and video card power, 
we will be in excellent shape by the end of this year. In 1999 we will have 64 
bit CPUs running at least four times faster than current technology. 

• We are using Microsoft Direct3D in Free Flight where others are coding in 
Open G/L, the Silicon Graphics standard. There is little functional difference 
between these standards. We chose Direct3D because it appeared there 
would be wider hardware support for it in the market. This is true for now but 
Microsoft and Silicon Graphics have recently agreed to merge their 
programming instructions (APIs) so one program will support either standard. 

FAA Certification 

• This is a big one. The hardware and software technologies needed for 
synthetic vision exist now with the most common, off the shelf computer 
standards. We are looking forward to synthetic vision use in the cockpit. It 
needs to be programmed a bit more, integrated with an acceptable hardware 
platform, tested in the simulator, flight-tested and certified under the auspices 
of the FAA. 
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Airline Management Acceptance 

• The commitment by corporate management to place their money and 
resources into deploying synthetic vision in the cockpits of their airplanes is a 
political matter. I believe this NASA Workshop, the commitments of the 
American Airline pilots union (APA), ALPA and IFALPA and others is building 
a consensus that will be unstoppable over the next several months in 1998. 
An airline pilot can make a tough case for synthetic vision simply by going on 
television with his daughter and letting the audience know he wants it to 
protect her with SV technology when she’s flying on his airplane. Or a pilots 
union can threaten to strike. These are difficult for an audience or airline 
management to ignore. 

The Future of Synthetic Vision 

A cursory look at the future of synthetic vision promises: 

• A “command" highway in the sky for navigation. It is a command roadway 
because it marks off the route of flight. This technology was researched 
extensively by George Hoover and proven workable. The highway is dynamic 
because it can change to adapt to different conditions. It may have some 
“intelligence" programmed into it for flexibility. The highway will allow the pilot 
to fly from takeoff, enroute, to a CAT III landing and taxi to his gate or parking 
spot. 

• Traffic in the immediate area will be displayed and potential conflicts 
highlighted to alert the pilot. TCAS could be the data source. Current sensor 
technology offers alternate solutions. 

• Weather will be presented in the synthetic vision space if it is hazardous. This 
data can be obtained from Wx radar, ground station sensors or satellites. The 
data uplinked from the ground via datalink or downlinked from satellites. 

• Windshear will also be displayed in the synthetic vision space. 

• Synthetic vision will be used in space navigation. 

• There will be many, many more applications for this technology. 

Jorj Baker, President 

Free Flight, Inc. 
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Synthetic/Enhanced Vision for Rotorcraft 


Synthetic/Enhanced Vision Systems for Rotorcraft 

Type-Specific Issues, Requirements, and Technical Challenges 


William S Hindson 

Chief, Flight Control and Cockpit Integration Branch 
Army/NASA Rotorcraft Division 
NASA Ames Research Center 

James M Daum 
"Human Factors Engineer 
Boeing Helicopters 


Presented at Synthetic Vision Workshop Two 
NASA Aviation Safety Program 27-29 Jan 98 



Synthetic/Enhanced Vision for Rotorcraft 


Objective 
Accident Statistics 
Rotorcraft Issues 

Technical Challenges and Requirements 
Potential solutions 
Prior NASA research 
Current NRTC/Boeing Activities 
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\_Army/NASA RotorcrafLDivisiQtL 

Synthetic/Enhanced Vision for Rotorcraft 

Objective 

Provide lowcost systems and procedures to: 

permit safe recovery from inadvertent entry into 
IMC in a near terrain environment 

enhance safety of high workload rotorcraft missions 
operating near terrain and close to obstacles 


I Armv/NASA Ro torcraH DMsIsnj — 

Synthetic/Enhanced Vision for Rotorcraft 


Accident Statistics 


from NTSB Database for Rotorcraft Accidents 




NTSB Codes for VFR Fit into IMC: 

attempted / inadvertent / continued / intentional / initiated 


326 




Issues Associated with Inadvertent IMC 

Rotorcraft have a greater vulnerability 

Likelihood of operating near terrain in poor visibility is greater 
Rotorcraft missions are usually low altitude 
Class G airspace weather minima are permissive 
IFR infrastructure / regulations often a disincentive 

Aircraft control in IMC is more demanding 

Stability is lacking - both hands and feet typically occupied 

Maintaining coordinated flight is more difficult 

Motion cues are confusing 

Vibration, rotor flicker can be distracting 

Instrument proficiency often deficient 

Recovery from unusual attitudes requires caution 


Armv/ NASA Rotorcraft Di ylsk>g_] 

Issues Associated with Inadvertent IMC ** 

Rotorcraft have a greater vulnerability 

Rotorcraft missions can be highly demanding (eg EMS) 
Single pilot, night, unfamiliar terrain 
Flight conditions include cruise, creep, or hover 
Propensity for drift into terrain or obstacles 
alleviated by good visual cues, vehicle stabilization 
Visual obscuration due to local flow field, downwash 
Need for “proximity warning" even with good visual cues 
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Technical Challenges 


Operating environments are random, unstructured (eg EMS) 
>» wide area databases required 

Low and slow missions demand greater scene detail and 
database resolution to support pilot orientation and control 
»> stretches database generation, storage, uploading, 
updating, processing & rendering requirements 

Proximity to surface and obstacles inherent with low altitude 
missions and permitted by Class G airspace weather minima 
»> fusion of stored database with vision aiding sensors 
needed to assure safety 


Technical Challenges 


Low cost, low weight, small size is paramount 

Registration requirements may exceed capability of most 
helicopters eg GPS positioning and heading accuracy 

Vision aiding sensor requires high field-of-view (regard) and 
high resolution 

Capability to detect wires highly desirable 

All-azimuth capability highly desirable 

Automobile technology could apply (proximity sensor) 
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w - -Army/NASA RotororatLOivisloru - 

Potential Solutions / Current Programs 


Terrain Awareness Laptop-based Products 

shortcomings are low resolution databases, 
mounting, need for a free hand to operate 

Enhanced GPWS 

costly, tailored to higher speed aircraft always in 
coordinated flight 

Low Cost vision aids 

scanning radar altimeter 

Automobile Technology 

94GHz proximity detection 


y/NASA Ro torcraft Divis ion ! 


Prior Research at NASA Ames RDEC 


Automated Nap-of-the-Earth (ANOE) Program 1990-1996 
Objectives: 

Develop and validate in flight test technologies for conducting 
terrain following / terrain avoidance flight in military rotorcraft 

Flight test sensors for obstacle detection and develop associated pilot 
displays and cueing for obstacle avoidance in nap-of the-Earth flight 

Develop automation pilot aids for enhanced safety and mission 
effectiveness in nap-of-the-Earth flight 


Example Results: 

Path generation and display guidance for TF/TA flight 
Scanning radar altimeter and associated grid world display 
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Syn thetic/Enhanced 
Vision for Rotorcraft 


PROJECT: 97-9.1(2) 
HELICOPTER 

OPERATIONS / APPROACH 
INVESTIGATION 


Boeing/NRTC Synthetic Vision System Activities 


Rotorcraft Approach by 
Visually Enhanced Navigatioi 

• Navigate using a high resolution 
3D data base during terminal 
approaches in near zero visibility 


RAVEN utilizes Differential GPS for^-— 
precise geolocation in a synthetically 
generated scene ^ 

The ultimate goal is to develop an afforda 
product that improves operational safety 

Optimize SV for tiltrotors and rotorcraft 


me^c^CiCTc 
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Synthetic/Enhanced 
Vision for Rotorcraft 


PROJECT: 97-9.1(2) 
HELICOPTER 

OPERATIONS / APPROACH 
INVESTIGATION 


WHY TILTROTOR / ROTORCRAFT SV 

• Move tiltrotors and rotorcraft out of flow of fixed wing 
traffic. 

- Increased departures and arrivals for air carriers 

- Improved efficiency of tiltrotor with direct routing below 
fixed-wing airspace 

• Tiltrotor approaches in terminal areas to precision 
approach minimums without the high cost of ILS 
equipment 

• Provide ability to operate in low visibility at low altitude 
to unimproved sites 

• Possibility to operate above obstacles in IMC with 
reference to synthetic terrain 
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o ** /r- ■ PROJECT: 97-9.1(2) 

Synthetic/Enhanced helicopter 

Vision for Rotorcraft operations / approach 

INVESTIGATION 



Rotorcraft / Tiltrotor Synthetic Vision Concept 





Aircraft \ Ground Equpmam 
Trin*pond«r tnd/or Rtllector Signal* 


Onboard 
Drift/ ant iai 
GPS Rtcttvtr 
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Synthetic/Enhanced 
Vision for Rotorcraft 


PROJECT: 97-9.1(2) 
HELICOPTER 

OPERATIONS / APPROACH 
INVESTIGATION 


Synthetic Vision 
Simulation 

- V-22 Tiltrotor 
Simulator 

- Terminal area/ 
urban database 

- Enhanced copy of 
urban database 
used as SV scene 

- Study of display, 
database, & 
symbology 
requirements 




Synthetic Scene with Symbology Overlay 

- Course-guidance “hoops” [aka pathway in the sky] displayed 
in synthetic vision 

- Synthetic Vision video scaled to match existing V-22 
^ __symbology & MFD’s 
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NASA Aviation Safety Program 
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Workshop on Synthetic Vision 
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Need to clearly identify system requirements up front 
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NASA Aviation Safety Program 
Synthetic Vision and Sensor Technology 
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management in low visibility 
conditions 



Steady Improvement in Airline Safety Due To 
Sophisticated Sensors at Airports and on Jets 

(Source: Wall Street Journal, Aug. 11,1997) 
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Reductions in crashes due to wind shear 
and midair collisions due to sophisticated 
sensors at airports and on jets 
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Current Approach to Avoid Airline Accidents 
Attributed to Controlled Flight Into Terrain (CFIT) 
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wurnsnop on syntnetic/tnnancecl Vision Display Systems 

| Session: Advanced Vision and Sensor Technology 


.5 CO 

= > 

?£ 
£ S 

o </> 

<<fr 


d> 

<5 

.i e 

= o> 

= 8. 

0 ) 52 

£i 


A 


as 

® cn 
- o 

c _ 


w <0 

CO Jr 

E s. 

o c- 

(£3 


£ 

1- 

LU 

.2 </) 

0 

X 

_l 

LL 

w* 

8 

CO 

E 

,? 

fc E 

si 
» s. 

c a) 

* 

8 

0 

E 

>» 

k- 

a> 

u 
>> <0 

LL 

$ 

| 8 

CO 

k. 

a> c 
N § 

2 

£ 5- 

a> 

a> 

0 & 

CO 

> 0 

Ql 

a co 



in 

O 

in 


T" 

CO 

rf 

r- 

csi 

cm 

CO 

1 

1 

1 

1 

O 

s 

in 

O 

CN| 


CO 

T- 

v* 

cm' 

CM 


341 




NASA A viation Safety Program 

Synthetic/Enhanced Vision Workshop 
Session: Advanced Vision and Sensor Technology 
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NASA Aviation Safety Program 

January 27-29, 1998 
Workshop on Synthetic/Enhanced Vision Display Systems 
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Landing is defined as acquisition 
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Runway out of service 
Continuing maintenance costs 
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What is the Real Sensor Performance 
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Cl 30 H3 to both AMC and AFSOC operational 
objectives. 


Detailed Requirements 
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other aids (to be defined) in outlining unmarked runways. 
'-►Assess the capability to identify runway incursions. 
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factor design with the first generation of image 
enhancement. 


San Francisco International Airport 
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Radar Video 
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Radar Video 
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The Schepens Eye Research Institute, 20 Stamford Street, Boston, Massachusetts 02114 Phone: (617) 921-2597 

E.Mail: eli@vision.eri.harvard.edu FAX: (617) 921-0111 



Scene-Linked Symbology 

Foyle, McCann & Shelden (1995) 



358 


o 

<j) 

CO 

CO 

O 

< 


(U 

3 

C 

(U 

“3 


alleviates attentional problems 





















Multi-Sensor Approach 
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Potential Sensors 
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Fusion Problems 
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One-Dimensional Example 
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Reverse Polarity 
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Graduate Institute M. Pavel 
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Oregon Graduate Institute M. Pavel 
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ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 




ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 








IR Image 



ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 














Fusion Method 



ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 






Difference Image (amplitude vs contrast) 



ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 



Visual Model 



ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 











Weighted Summation 
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ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 









Depth Cues 



ATLANTIC AEROSPACE 
ELECTRONICS CORPORATION 
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Flight Management & Human Factors Division 
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Flight Management & Human Factors Division 
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27 - 29 January 1998 
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A successful S/EVS thrust should present the various 
aviation sectors with responsive architectures leveraging a 
broad spectrum of available sensors/technological approaches 



To Solve CFIT and visibility induced errors 
A Terrain Database Is the Answer - 
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To Solve CFIT and visibility induced errors 
Terrain Data Is Augmented with Enhanced 
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To Solve CFIT and visibility induced errors 
Let Us Not Put the Cart Before the Horse 

A 3-Dimensional View 
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Reliability, Redundancy, 
\ Certification , 




Feedback to the Safety Program 

S/EVS Thrust 
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bodies (windshear example) 
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